-- Logs begin at Mon 2022-05-23 15:46:28 UTC, end at Mon 2022-05-23 17:09:31 UTC. -- May 23 16:25:08.099411 dv-cinder-839257-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 23 16:25:08.108792 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 16:25:08 2022] *** May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: nodename: dv-cinder-839257-3-iscsi May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: machine: x86_64 May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: clock source: unix May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: pcre jit disabled May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: detected number of CPU cores: 4 May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: current working directory: / May 23 16:25:08.110804 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: detected binary path: /usr/bin/uwsgi-core May 23 16:25:08.111354 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: your processes number limit is 47680 May 23 16:25:08.111354 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: your memory page size is 4096 bytes May 23 16:25:08.111354 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: detected max file descriptor number: 2048 May 23 16:25:08.111354 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: lock engine: pthread robust mutexes May 23 16:25:08.111354 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: thunder lock: enabled May 23 16:25:08.111354 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 23 16:25:08.111354 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 16:25:08.156324 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: Python main interpreter initialized at 0x55d08a1449c0 May 23 16:25:08.156324 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: python threads support enabled May 23 16:25:08.156324 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: your server socket listen backlog is limited to 100 connections May 23 16:25:08.156324 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: your mercy for graceful operations on workers is 90 seconds May 23 16:25:08.156679 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: mapped 403077 bytes (393 KB) for 2 cores May 23 16:25:08.156754 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: *** Operational MODE: preforking *** May 23 16:25:08.157028 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: *** uWSGI is running in multiple interpreter mode *** May 23 16:25:08.157028 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: spawned uWSGI master process (pid: 80662) May 23 16:25:08.157264 dv-cinder-839257-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 23 16:25:08.158183 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: spawned uWSGI worker 1 (pid: 80675, cores: 1) May 23 16:25:08.158183 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: spawned uWSGI worker 2 (pid: 80676, cores: 1) May 23 16:25:08.158349 dv-cinder-839257-3-iscsi devstack@keystone.service[80662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 16:25:13.869521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:25:13.869521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: from cryptography.utils import int_from_bytes May 23 16:25:13.870293 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:25:13.870293 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: from cryptography.utils import int_from_bytes May 23 16:25:13.919661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 16:25:13.919886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 16:25:13.920058 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] command line args: [] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 16:25:13.920312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 16:25:13.920492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ================================================================================ {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 16:25:13.920746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] admin_token = **** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.920991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] config_dir = [] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.921176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.921357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] config_source = [] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.921536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] debug = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.921732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] list_limit = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] log_config_append = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] log_dir = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] log_file = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.923808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.924054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.924328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.924568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.924746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.924921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.925169 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.925413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.925644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.925875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.926104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.926333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.926577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.926819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.927090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.927570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.74/identity {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.927750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] publish_errors = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.927981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.928207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.928412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.928657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.928888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.929119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] standard_threads = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.929346 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.929583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.929757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.929931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] use_journal = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.930103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] use_json = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.930276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] use_stderr = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.930449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] use_syslog = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.930679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:13.930930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.931166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.931422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.931658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.931904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.932138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.932408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.932646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.932893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.933136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.933383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.933659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.933905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.934141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.934385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.934630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.934864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.935118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.935369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.935614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.935849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.936098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.936381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.936631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.936877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.937106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.937334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.937561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.937795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.938040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.938283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.938511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.938741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.938988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.939237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.939472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.939719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.939949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.940166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.940425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.940656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.940884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.941113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.941341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.941576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.941823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.942051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.942284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.942513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.942747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.942982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.943230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.943461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.943698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.943933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.944168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.944427 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.944663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.944893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.945145 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.945381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.945617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.945848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.946103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.946340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.946569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.946805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.947039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.947303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.947539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.947786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.948028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.948262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.948521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.948755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.949000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.949779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.950009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.950251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.950487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.950721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.950956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.951190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.951423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.951680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.951919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.952157 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.952416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.952657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.952892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.953126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.953359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.953587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.953816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.954043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.954277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.954504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.954739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.954973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.955222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.955454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.955706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.955960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.956199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.956452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] auth.external = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.956680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.956971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.957202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.957430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] auth.password = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.957658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] auth.token = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.957892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.958127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.958371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.958598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.958842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.959089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.959319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.959553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] credential.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.959798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.960045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.960319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.960475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:25:13.960475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: from cryptography.utils import int_from_bytes May 23 16:25:13.961072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.961205 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:25:13.961205 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: from cryptography.utils import int_from_bytes May 23 16:25:13.961562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.961562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.961562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.961562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.962055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.962055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.962347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.962484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.962766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.962902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.963148 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.963384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] federation.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.963618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.963863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.964109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.964358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.964606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.965486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.965744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.966086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.966346 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.966584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.966832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.967069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.967315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.967562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.967797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.968033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.968276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.968529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.968766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.969012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.969262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.969491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.969720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.969949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.970192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.970470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.970677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.970928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.971171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.971439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.971675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.971910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.972139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.972403 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.972632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.972868 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.973107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.973344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.973591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.973820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.974085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.974309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.974543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.974787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.975031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.975259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.975508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.975736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.975971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.976206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.976471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.976691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.976930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.977178 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.977423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.977653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.977882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.978128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.978373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.978692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.978973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.979251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.979481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.979762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.980234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.980607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.980992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.981243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.981492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.981730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.981961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.982196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.982430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.982666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.982895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.983140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.983385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.983629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.983872 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.984115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.984369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.984616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.984851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.985085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.985322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.985555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.985798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.986043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.986277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.986528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.986756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.986998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.987231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.987477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.987711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.987954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.988196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.988451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.988685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.988926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] resource.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.989277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.989530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.989766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.990016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.990265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.990502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.990749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.990985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.991222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.991459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] role.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.991704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] role.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.991933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.992182 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.992453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.992703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.992949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.993195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.993440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.993684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.993928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.994160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.994405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.994651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.994896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.995141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.995553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.995789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.996128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.996446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.996729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.996936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.997171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.997425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.997675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.997925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.998158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.998391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.998623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.998870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.999122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.999376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.999613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:13.999849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.000078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.000343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] token.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.000584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.000830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.001066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.001322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.001568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.001805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.002046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.002288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.002533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.002768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.003006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.003241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.003485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.003732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.003960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.004203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.004519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.004789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.connection = **** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.005032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.005284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.005520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.005761 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.005997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.006232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.006468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.006702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.006945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.007180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.007422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.007656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.007903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.008137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.008405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.008638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.008880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.009073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 16:25:14.009227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.009362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 16:25:14.009496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 16:25:14.009629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] command line args: [] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 16:25:14.009760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 16:25:14.009899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ================================================================================ {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 16:25:14.010138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] admin_token = **** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.010392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] config_dir = [] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.010585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.010770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] config_source = [] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.010953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] debug = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.011169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.011424 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.012106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.012960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.013230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.013476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] list_limit = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.013664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] log_config_append = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.013848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.014030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] log_dir = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.014211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] log_file = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.014454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.014709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.014962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.015214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.015396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.015577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.015826 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.016077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.016341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.016585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.016899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.017047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.017299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.017550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.017832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.018327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.74/identity {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.018514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] publish_errors = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.018750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.018984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.019165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.019414 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.019654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.019894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] standard_threads = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.020132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.020413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.020596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.020775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] use_journal = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.020953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] use_json = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.021132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] use_stderr = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.021312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] use_syslog = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.021549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:25:14.021811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.022055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.022585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.022833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.023090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.023335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.023589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.023830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.024084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.024357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.024614 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.024856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.025110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.025354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.025606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.025858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.026100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.026360 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.026621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.026874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.027118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.028020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.028771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.029036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.029299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.029543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.029784 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.030025 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.030272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.030535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.030791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.031027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.031264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.031520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.031772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.032015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.032278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.032539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.032782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.033033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.033270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.033508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.033747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.033985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.034230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.034485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.034726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.034970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.035207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.035451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.035694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.035948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.036185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.036457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.036704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.036948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.037192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.037435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.037740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.038077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.038377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.038679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.038974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.039319 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.039618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.039912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.040218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.040541 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.040894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.041050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.041185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.041320 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.041451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.041587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.041835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.042134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.042432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.042729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.043338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.043650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.043986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.044463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.044812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.045070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.045316 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.045561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.045805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.046074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.046323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.046571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.046816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.047064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.047309 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.047550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.047792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.048028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.048263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.048523 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.048766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.049011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.049261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.049506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.049760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.049927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.050077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.050258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.050522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.050768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.051006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] auth.external = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.051242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.051546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.051786 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.052023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] auth.password = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.052260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] auth.token = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.052530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.052775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.053028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.053267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.053521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.053776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.054012 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.054255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] credential.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.054508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.054763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.055015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.055258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.055507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.055750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.056019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.056279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.056552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.056812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.057104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.057356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.057627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.057874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.058138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.058383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] federation.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.059710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.059973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.060233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.060504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.060761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.061008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.061270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.061515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.061776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.062019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.062274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.062518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.062778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.063037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.063281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.063524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.063886 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.064127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.064401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.064661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.064924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.065166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.065405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.065644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.065898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.066151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.066406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.066668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.066922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.067198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.067442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.067685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.067923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.068167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.068427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.068672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.068919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.069164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.069418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.069654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.069906 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.070163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.070405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.070657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.070911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.071146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.071390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.071625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.071868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.072110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.072382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.072628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.072871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.073124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.073377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.073615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.073849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.074101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.074928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.075180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.075428 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.075673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.075913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.076161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.076450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.076690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.076944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.077195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.077446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.077688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.077923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.078164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.078352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.078503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.078643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.078784 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.078923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.079089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.079340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.079590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.079840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.080090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.080349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.080602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.080844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.081084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.081325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.081565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.081816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.082081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.082324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.082583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.082820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.083072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.083314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.083557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.083799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.084062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.084327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.084571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.084814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.085061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] resource.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.085318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.085573 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.085814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.086068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.086323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.086564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.086814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.087057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.087302 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.087543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] role.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.087795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] role.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.088030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.088283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.088562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.088815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.089068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.089320 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.089571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.090475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.091048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.091292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.091549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.091806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.092061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.092333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.092753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.092995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.093250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.093503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.093754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.094008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.094247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.094505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.094762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.095005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.095242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.095478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.095713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.095970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.096228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.096507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.096754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.097009 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.097247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.097491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] token.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.097734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.097987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.098230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.098490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.098741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.098985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.099234 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.099483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.099732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.099973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.100215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.100479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.100734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.100985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.101221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.101470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.101775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.102041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.connection = **** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.102292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.102544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.102785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.103033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.103274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.103515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.103755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.103995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.104245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.104514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.104763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.105014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.105265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.106520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.106795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.107042 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.107299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.107548 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:25:14.107725 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 16:25:14.131197 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.134525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.134761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.134989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.144196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.164031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.164263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.182851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.183080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.205142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.242490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.242728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.248888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.249117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.249335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.249549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.249763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.249974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.273038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.273267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.273488 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.273707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.273922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.274132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.274342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.286131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.289384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.289627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.289857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.290082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.290304 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.290524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.298601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.298829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.299049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.299267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.299482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.299694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.299904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.303983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.304224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.304476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.304701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.304922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.305141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.305358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.314479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.317633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.317871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.318096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.318316 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.318533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.318746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.318960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 16:25:14.319326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.319537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 16:25:14.319870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.320069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 16:25:14.320415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.320624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.320879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.321130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.330148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.330363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 16:25:14.330698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.330901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 16:25:14.331189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.331451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.331719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.331977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.332321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.332584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.332847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.333120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.341815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.343983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.344261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.344557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.344838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.345137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.345410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.345685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.345959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.346233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.346486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.346857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.347126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.347389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.347657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.347919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.353169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.357193 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.357478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.357761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.358052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.358343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.358617 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.358889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.359177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.359446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.359717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.360088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.375265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.377017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.377292 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.382606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.382843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.383117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.388521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.390169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.390449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.390740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.391018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.395506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.395903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.396064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.396205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.396383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.396541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.396683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.396822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.396987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.397501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.397763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.405140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.405425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.409987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.410281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.410571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.410862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.411140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.411426 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.411803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.412090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.417138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.417413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.422680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.426373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.426661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.431773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.431940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.432150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.435490 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.437461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.439375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.439668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.439955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.440243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.440540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.440818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.441191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.441488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.446535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.451144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.454849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.455146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.455430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.455710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.455992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.456430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.466124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.466410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.466674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.466933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.475045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.476604 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.476777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.476921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.477062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.477204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.477396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.480098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.480901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.481195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.481651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.481931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.486521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.488227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.488532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.491612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.491905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.492194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.492501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.492781 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.495532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.495808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.496981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.497203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.497419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.497692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.497973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.508497 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.508780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.509062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.509343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.509627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.509913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.510190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.516259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.519567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.523216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.524862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.526508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.526795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.527074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.529790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.533223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.534595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.536224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.536613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.538229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.539551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.539839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.539989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.540133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.540274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.540518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.540678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.548806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.550182 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.550467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.550617 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.550847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.553805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.554105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.554393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.554682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.559394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.559674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.559951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.560219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.560513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.560780 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.561068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.561332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.561604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.561870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.562147 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.562417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.562687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.562943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.564937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.565236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.565520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.574920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 16:25:14.575201 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.575494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.575775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.576052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.576358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.576640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.576929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.577222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.577493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.577765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.578035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.578302 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.578563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 16:25:14.602006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d08a1449c0 pid: 80675 (default app) May 23 16:25:14.605243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ace75-41b9-43fb-87c6-774b8329803e None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:14.606057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ace75-41b9-43fb-87c6-774b8329803e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:14.606413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ace75-41b9-43fb-87c6-774b8329803e None None] PATH_INFO: `/v3` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:14.610778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 791 bytes} [Mon May 23 16:25:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:14.618030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d08a1449c0 pid: 80676 (default app) May 23 16:25:23.465271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb353b7-4905-49ba-b41f-6dcdb008edbf None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:23.465816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb353b7-4905-49ba-b41f-6dcdb008edbf None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:23.465816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb353b7-4905-49ba-b41f-6dcdb008edbf None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:23.467110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 2/2] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:25:23.474343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:23.474765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:23.474900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:23.544607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: INFO dbcounter [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] Registered counter for database keystone May 23 16:25:23.565787 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG oslo_db.sqlalchemy.engines [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:25:23.572018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writer thread running {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:25:23.751781 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG passlib.handlers.bcrypt [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80676) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 16:25:23.752118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG passlib.handlers.bcrypt [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80676) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 16:25:23.808057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:23.809802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:23.937996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1/3] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 16:25:24.082468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb353b7-4905-49ba-b41f-6dcdb008edbf None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:24.151564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: INFO dbcounter [None req-bbb353b7-4905-49ba-b41f-6dcdb008edbf None None] Registered counter for database keystone May 23 16:25:24.171717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb353b7-4905-49ba-b41f-6dcdb008edbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:25:24.177938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writer thread running {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:25:24.298158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb353b7-4905-49ba-b41f-6dcdb008edbf None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:24.302441 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c38ff-2f96-4af5-9acd-17632efc8858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:24.303101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c38ff-2f96-4af5-9acd-17632efc8858 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:24.303388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c38ff-2f96-4af5-9acd-17632efc8858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:24.303668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c38ff-2f96-4af5-9acd-17632efc8858 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:24.311827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c38ff-2f96-4af5-9acd-17632efc8858 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:24.363756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7f4c38ff-2f96-4af5-9acd-17632efc8858 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 16:25:24.364045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c38ff-2f96-4af5-9acd-17632efc8858 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:24.373754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 3/4] 10.222.0.74 () {58 vars in 1324 bytes} [Mon May 23 16:25:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:25:24.379827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:24.397164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc0bfb-45b3-4623-8955-26af30e090ed None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:24.401496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af3bc4-7562-4385-9a69-4dd786beeb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:24.403305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af3bc4-7562-4385-9a69-4dd786beeb14 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:24.403586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af3bc4-7562-4385-9a69-4dd786beeb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:24.403859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af3bc4-7562-4385-9a69-4dd786beeb14 admin admin] PATH_INFO: `/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:24.405365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af3bc4-7562-4385-9a69-4dd786beeb14 admin admin] RBAC: Authorizing `identity:get_project(project_id=a06edcae6b7a4521b29d4cfac1cfa2c1)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:24.455665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WARNING keystone.common.rbac_enforcer.enforcer [None req-51af3bc4-7562-4385-9a69-4dd786beeb14 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 16:25:24.455999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af3bc4-7562-4385-9a69-4dd786beeb14 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:24.460575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 2/5] 10.222.0.74 () {56 vars in 1207 bytes} [Mon May 23 16:25:24 2022] GET /identity/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:26.622429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657c6e7-43cf-416f-960e-c6cf74a0d593 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:26.622970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657c6e7-43cf-416f-960e-c6cf74a0d593 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:26.622970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657c6e7-43cf-416f-960e-c6cf74a0d593 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:26.627106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 4/6] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:26.632589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d715-a7c5-43a0-8101-b973353f9ff3 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:26.632975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d715-a7c5-43a0-8101-b973353f9ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:26.633140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d715-a7c5-43a0-8101-b973353f9ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:26.653075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-44b4d715-a7c5-43a0-8101-b973353f9ff3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:26.654576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-44b4d715-a7c5-43a0-8101-b973353f9ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:26.662292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 3/7] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 23 16:25:26.684838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657c6e7-43cf-416f-960e-c6cf74a0d593 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:26.696848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657c6e7-43cf-416f-960e-c6cf74a0d593 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:26.701256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26f845-30ff-421c-a71c-bfdd449fd890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:26.701886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f845-30ff-421c-a71c-bfdd449fd890 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:26.702174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f845-30ff-421c-a71c-bfdd449fd890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:26.702452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f845-30ff-421c-a71c-bfdd449fd890 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:26.710126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26f845-30ff-421c-a71c-bfdd449fd890 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:26.711914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26f845-30ff-421c-a71c-bfdd449fd890 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:26.720854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 5/8] 10.222.0.74 () {58 vars in 1324 bytes} [Mon May 23 16:25:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:25:26.726415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4d715-a7c5-43a0-8101-b973353f9ff3 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:26.736446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4d715-a7c5-43a0-8101-b973353f9ff3 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:26.740880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de8413-5219-40c8-9f8d-8cb4a618c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:26.741743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de8413-5219-40c8-9f8d-8cb4a618c178 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:26.742029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de8413-5219-40c8-9f8d-8cb4a618c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:26.742310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de8413-5219-40c8-9f8d-8cb4a618c178 admin admin] PATH_INFO: `/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:26.743691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de8413-5219-40c8-9f8d-8cb4a618c178 admin admin] RBAC: Authorizing `identity:get_user(user_id=9f0fe22fa44447e8acda5720d7e2ffa6)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:26.746512 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de8413-5219-40c8-9f8d-8cb4a618c178 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:26.748087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 4/9] 10.222.0.74 () {56 vars in 1198 bytes} [Mon May 23 16:25:26 2022] GET /identity/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:29.018516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b448c8-0a9e-4c1e-9ba0-014a67704ba1 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.019034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b448c8-0a9e-4c1e-9ba0-014a67704ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.019134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b448c8-0a9e-4c1e-9ba0-014a67704ba1 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.020648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 6/10] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:25:29.026050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5e0fc-d3ab-4d80-a69f-12e4266a08fa None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.027130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5e0fc-d3ab-4d80-a69f-12e4266a08fa None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.027216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996f00-f1cd-48c5-afe5-875bac44d0fe None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.027429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5e0fc-d3ab-4d80-a69f-12e4266a08fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.027707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996f00-f1cd-48c5-afe5-875bac44d0fe None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.028037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996f00-f1cd-48c5-afe5-875bac44d0fe None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.029356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 7/11] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:25:29.034500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367652f-80a9-42a3-9e22-e632dd073abc None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.034790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367652f-80a9-42a3-9e22-e632dd073abc None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.035071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367652f-80a9-42a3-9e22-e632dd073abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.044200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-f3b5e0fc-d3ab-4d80-a69f-12e4266a08fa None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:29.045419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f3b5e0fc-d3ab-4d80-a69f-12e4266a08fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:29.075875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG passlib.handlers.bcrypt [None req-f367652f-80a9-42a3-9e22-e632dd073abc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80675) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 16:25:29.076327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG passlib.handlers.bcrypt [None req-f367652f-80a9-42a3-9e22-e632dd073abc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80675) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 16:25:29.122618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-f367652f-80a9-42a3-9e22-e632dd073abc None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:29.124221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f367652f-80a9-42a3-9e22-e632dd073abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:29.127208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 5/12] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:29.151232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5e0fc-d3ab-4d80-a69f-12e4266a08fa None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:29.174656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:29.228565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 8/13] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:25:29.250804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367652f-80a9-42a3-9e22-e632dd073abc None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:29.257603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5e0fc-d3ab-4d80-a69f-12e4266a08fa None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:29.291945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab03ce-6261-4e5e-b64f-53f437687387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:29.293335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab03ce-6261-4e5e-b64f-53f437687387 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.293623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab03ce-6261-4e5e-b64f-53f437687387 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.293902 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab03ce-6261-4e5e-b64f-53f437687387 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.307033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab03ce-6261-4e5e-b64f-53f437687387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-41ab03ce-6261-4e5e-b64f-53f437687387 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:29.318978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:29.320207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:29.321079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 6/14] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:25:29.326659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab03ce-6261-4e5e-b64f-53f437687387 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:29.413893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:29.432685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab03ce-6261-4e5e-b64f-53f437687387 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:29.462296 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367652f-80a9-42a3-9e22-e632dd073abc None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:29.465714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:29.468123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340442a-76ba-4d52-8316-e50e84b7d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:29.468829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340442a-76ba-4d52-8316-e50e84b7d530 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.469116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340442a-76ba-4d52-8316-e50e84b7d530 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.469396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340442a-76ba-4d52-8316-e50e84b7d530 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.470151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340442a-76ba-4d52-8316-e50e84b7d530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:29.470629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340442a-76ba-4d52-8316-e50e84b7d530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:29.471866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340442a-76ba-4d52-8316-e50e84b7d530 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:29.484125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 7/15] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:29.489699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340442a-76ba-4d52-8316-e50e84b7d530 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:29.501206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46462f73-f1e9-4454-a998-102fc2b81fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:29.502422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46462f73-f1e9-4454-a998-102fc2b81fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.502718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46462f73-f1e9-4454-a998-102fc2b81fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.503000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46462f73-f1e9-4454-a998-102fc2b81fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.570930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46462f73-f1e9-4454-a998-102fc2b81fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:29.572433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46462f73-f1e9-4454-a998-102fc2b81fd6 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:29.588030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340442a-76ba-4d52-8316-e50e84b7d530 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:29.623288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd02d94-f468-41b1-a6de-77be1ceb298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:29.624159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd02d94-f468-41b1-a6de-77be1ceb298b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.624474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd02d94-f468-41b1-a6de-77be1ceb298b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.624761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd02d94-f468-41b1-a6de-77be1ceb298b None admin] PATH_INFO: `/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.625972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd02d94-f468-41b1-a6de-77be1ceb298b None admin] RBAC: Authorizing `identity:get_user(user_id=9f0fe22fa44447e8acda5720d7e2ffa6)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:29.627430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd02d94-f468-41b1-a6de-77be1ceb298b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:29.629084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 8/16] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:29 2022] GET /identity/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:29.634442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd02d94-f468-41b1-a6de-77be1ceb298b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:29.649268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:29.671637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 9/17] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:25:29.677480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46462f73-f1e9-4454-a998-102fc2b81fd6 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:29.680670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:29.784785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46462f73-f1e9-4454-a998-102fc2b81fd6 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:29.819393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebf5dd-aa02-4612-94e5-10832c0c8799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:29.820263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebf5dd-aa02-4612-94e5-10832c0c8799 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.820578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebf5dd-aa02-4612-94e5-10832c0c8799 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.820852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebf5dd-aa02-4612-94e5-10832c0c8799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.845410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebf5dd-aa02-4612-94e5-10832c0c8799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:29.846827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebf5dd-aa02-4612-94e5-10832c0c8799 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:29.847381 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd02d94-f468-41b1-a6de-77be1ceb298b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-71ebf5dd-aa02-4612-94e5-10832c0c8799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:25:29.866952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:29.867939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:29.868845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:25:29.868845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:25:29.868845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:25:29.868845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:25:29.868845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 10/18] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:29.874645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebf5dd-aa02-4612-94e5-10832c0c8799 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:29.882182 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e550a-2317-4cdf-b45a-5fb70e37b9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:29.882983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e550a-2317-4cdf-b45a-5fb70e37b9bd None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:29.883268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e550a-2317-4cdf-b45a-5fb70e37b9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:29.883547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e550a-2317-4cdf-b45a-5fb70e37b9bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:29.884743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e550a-2317-4cdf-b45a-5fb70e37b9bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:29.886749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e550a-2317-4cdf-b45a-5fb70e37b9bd None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:29.888370 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 9/19] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:29.893851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e550a-2317-4cdf-b45a-5fb70e37b9bd None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:29.931224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:29.974124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:29.977407 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebf5dd-aa02-4612-94e5-10832c0c8799 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:29.992700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e550a-2317-4cdf-b45a-5fb70e37b9bd None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:30.014048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0b05f-85b7-448d-8b05-1c1f712a5145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:30.014709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0b05f-85b7-448d-8b05-1c1f712a5145 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:30.014991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0b05f-85b7-448d-8b05-1c1f712a5145 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:30.015263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0b05f-85b7-448d-8b05-1c1f712a5145 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:30.015983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0b05f-85b7-448d-8b05-1c1f712a5145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:30.016287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0b05f-85b7-448d-8b05-1c1f712a5145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:30.017732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0b05f-85b7-448d-8b05-1c1f712a5145 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:30.029014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046bc19-0a65-4e23-be4c-f1d78c62168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:30.029672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046bc19-0a65-4e23-be4c-f1d78c62168b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:30.029959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046bc19-0a65-4e23-be4c-f1d78c62168b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:30.030239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046bc19-0a65-4e23-be4c-f1d78c62168b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:30.031068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046bc19-0a65-4e23-be4c-f1d78c62168b None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.domain.id=default, user.id=9f0fe22fa44447e8acda5720d7e2ffa6) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:30.031379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046bc19-0a65-4e23-be4c-f1d78c62168b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:30.032848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046bc19-0a65-4e23-be4c-f1d78c62168b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:30.035651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 11/20] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:30.039512 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 10/21] 10.222.0.74 () {56 vars in 1322 bytes} [Mon May 23 16:25:29 2022] GET /identity/v3/role_assignments?user.id=9f0fe22fa44447e8acda5720d7e2ffa6&scope.domain.id=default&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:32.613326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc42c42-3bf3-4a61-89b8-5da3ae0933f7 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:32.613855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc42c42-3bf3-4a61-89b8-5da3ae0933f7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:32.613855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc42c42-3bf3-4a61-89b8-5da3ae0933f7 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:32.615235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 12/22] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:32.621554 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ca185-6231-415e-8101-fc1d521d4ba5 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:32.622430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ca185-6231-415e-8101-fc1d521d4ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:32.622913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ca185-6231-415e-8101-fc1d521d4ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:32.649891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6f4ca185-6231-415e-8101-fc1d521d4ba5 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:32.651583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6f4ca185-6231-415e-8101-fc1d521d4ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:32.746706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 11/23] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:32.758807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ea14-08ac-4c1f-95c1-3cd621cbbc5e None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:32.759377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ea14-08ac-4c1f-95c1-3cd621cbbc5e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:32.759857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ea14-08ac-4c1f-95c1-3cd621cbbc5e None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:32.763696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 13/24] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:32.768072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c856-f575-4beb-a362-97db7c9d54d1 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:32.768389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c856-f575-4beb-a362-97db7c9d54d1 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:32.768671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c856-f575-4beb-a362-97db7c9d54d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:32.780000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ea14-08ac-4c1f-95c1-3cd621cbbc5e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:32.787307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8861c856-f575-4beb-a362-97db7c9d54d1 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:32.789556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8861c856-f575-4beb-a362-97db7c9d54d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:32.880499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 12/25] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:32.947212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ea14-08ac-4c1f-95c1-3cd621cbbc5e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:32.962260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861c856-f575-4beb-a362-97db7c9d54d1 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:32.966394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:32.989912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:33.025739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48ae39-96d1-4dab-a068-8d29f59402fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:33.027970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ae39-96d1-4dab-a068-8d29f59402fc None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:33.030435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ae39-96d1-4dab-a068-8d29f59402fc None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:33.030935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ae39-96d1-4dab-a068-8d29f59402fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:33.055829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ae39-96d1-4dab-a068-8d29f59402fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-3f48ae39-96d1-4dab-a068-8d29f59402fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:33.066737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:33.067630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:33.068507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:25:33.071468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 14/26] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:33.073433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f742d-736b-43ff-b9a2-a37061cb8807 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:33.073935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f742d-736b-43ff-b9a2-a37061cb8807 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:33.074424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f742d-736b-43ff-b9a2-a37061cb8807 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:33.076564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 15/27] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:33.077813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f742d-736b-43ff-b9a2-a37061cb8807 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:33.201216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f742d-736b-43ff-b9a2-a37061cb8807 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:33.238575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861c856-f575-4beb-a362-97db7c9d54d1 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:33.241640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a57c26-e97f-467c-a8d8-83a614e0651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:33.242595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a57c26-e97f-467c-a8d8-83a614e0651b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:33.243082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a57c26-e97f-467c-a8d8-83a614e0651b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:33.243575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a57c26-e97f-467c-a8d8-83a614e0651b None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:33.244636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a57c26-e97f-467c-a8d8-83a614e0651b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:33.245713 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a57c26-e97f-467c-a8d8-83a614e0651b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:33.247553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a57c26-e97f-467c-a8d8-83a614e0651b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:33.261278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 16/28] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:33.263051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e246-0ddd-44bc-b8e5-29232ee92e8e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:33.263572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e246-0ddd-44bc-b8e5-29232ee92e8e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:33.264049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e246-0ddd-44bc-b8e5-29232ee92e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:33.283545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-0765e246-0ddd-44bc-b8e5-29232ee92e8e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:33.285384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0765e246-0ddd-44bc-b8e5-29232ee92e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:33.290015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b4a3b-8183-44d7-aee3-b695ae5c5c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:33.290829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b4a3b-8183-44d7-aee3-b695ae5c5c76 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:33.291111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b4a3b-8183-44d7-aee3-b695ae5c5c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:33.291387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b4a3b-8183-44d7-aee3-b695ae5c5c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:33.314825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b4a3b-8183-44d7-aee3-b695ae5c5c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:33.316361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b4a3b-8183-44d7-aee3-b695ae5c5c76 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:33.320781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-5c8b4a3b-8183-44d7-aee3-b695ae5c5c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:25:33.358366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:33.359257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:33.360064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:25:33.360064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:25:33.360064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:25:33.360064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:33.360064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 13/29] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:33.360470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b4a3b-8183-44d7-aee3-b695ae5c5c76 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:33.369192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 17/30] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:33.371180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e246-0ddd-44bc-b8e5-29232ee92e8e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:33.457677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:33.519278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b4a3b-8183-44d7-aee3-b695ae5c5c76 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:33.582473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d63584-05a9-44b4-aa6c-176399cbbd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:33.583347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d63584-05a9-44b4-aa6c-176399cbbd85 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:33.583628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d63584-05a9-44b4-aa6c-176399cbbd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:33.583902 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d63584-05a9-44b4-aa6c-176399cbbd85 None admin] PATH_INFO: `/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:33.587228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e246-0ddd-44bc-b8e5-29232ee92e8e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:33.589101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d63584-05a9-44b4-aa6c-176399cbbd85 None admin] RBAC: Authorizing `identity:get_user(user_id=9f0fe22fa44447e8acda5720d7e2ffa6)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:33.590875 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d63584-05a9-44b4-aa6c-176399cbbd85 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:33.592525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 14/31] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:33 2022] GET /identity/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:33.593297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d63584-05a9-44b4-aa6c-176399cbbd85 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:33.654574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd208-9bec-4ba8-9b7c-e199bcb1af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:33.655249 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd208-9bec-4ba8-9b7c-e199bcb1af4d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:33.655540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd208-9bec-4ba8-9b7c-e199bcb1af4d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:33.655815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd208-9bec-4ba8-9b7c-e199bcb1af4d None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:33.656597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdd208-9bec-4ba8-9b7c-e199bcb1af4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:33.656904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdd208-9bec-4ba8-9b7c-e199bcb1af4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:33.658335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdd208-9bec-4ba8-9b7c-e199bcb1af4d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:33.685489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 18/32] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:33.686358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd208-9bec-4ba8-9b7c-e199bcb1af4d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:33.734901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:33.739848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d63584-05a9-44b4-aa6c-176399cbbd85 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:33.764221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:33.775463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d72c7-c06b-4a72-9f6a-7963d927eb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:33.777085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d72c7-c06b-4a72-9f6a-7963d927eb10 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:33.777395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d72c7-c06b-4a72-9f6a-7963d927eb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:33.777668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d72c7-c06b-4a72-9f6a-7963d927eb10 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:33.778939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d72c7-c06b-4a72-9f6a-7963d927eb10 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:33.780628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d72c7-c06b-4a72-9f6a-7963d927eb10 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:33.817431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd208-9bec-4ba8-9b7c-e199bcb1af4d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:33.855066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6077689-a341-4c44-ba6d-08a1079e0212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:33.855921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6077689-a341-4c44-ba6d-08a1079e0212 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:33.856218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6077689-a341-4c44-ba6d-08a1079e0212 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:33.856523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6077689-a341-4c44-ba6d-08a1079e0212 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:33.859368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6077689-a341-4c44-ba6d-08a1079e0212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:33.859527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6077689-a341-4c44-ba6d-08a1079e0212 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:33.862031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 19/33] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:33.862031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6077689-a341-4c44-ba6d-08a1079e0212 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:33.961037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:33.967521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6077689-a341-4c44-ba6d-08a1079e0212 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:34.004491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 15/34] 10.222.0.74 () {60 vars in 1131 bytes} [Mon May 23 16:25:33 2022] POST /identity/v3/roles => generated 219 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:34.004491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813232b8-cef5-41a7-a94f-21f42a2e4884 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.004491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813232b8-cef5-41a7-a94f-21f42a2e4884 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.004491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813232b8-cef5-41a7-a94f-21f42a2e4884 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.004491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 16/35] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:34.004491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813232b8-cef5-41a7-a94f-21f42a2e4884 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:34.011249 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e58d9-d307-46b2-b93b-19477726b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:34.011609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e58d9-d307-46b2-b93b-19477726b44f None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.011862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e58d9-d307-46b2-b93b-19477726b44f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.012141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e58d9-d307-46b2-b93b-19477726b44f None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.012929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e58d9-d307-46b2-b93b-19477726b44f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:34.014601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e58d9-d307-46b2-b93b-19477726b44f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:34.137491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813232b8-cef5-41a7-a94f-21f42a2e4884 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:34.182656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b970e-8bcd-4a89-9788-418ce9307695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:34.183661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b970e-8bcd-4a89-9788-418ce9307695 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.183945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b970e-8bcd-4a89-9788-418ce9307695 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.184230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b970e-8bcd-4a89-9788-418ce9307695 None admin] PATH_INFO: `/v3/domains/default/users/9f0fe22fa44447e8acda5720d7e2ffa6/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.186988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b970e-8bcd-4a89-9788-418ce9307695 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9f0fe22fa44447e8acda5720d7e2ffa6, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:34.188885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b970e-8bcd-4a89-9788-418ce9307695 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:34.268621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 20/36] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:25:33 2022] POST /identity/v3/projects => generated 301 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:34.270356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b0766-e6ac-48e1-b301-616b2e83a48c None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.270700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b0766-e6ac-48e1-b301-616b2e83a48c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.270989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b0766-e6ac-48e1-b301-616b2e83a48c None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.272564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 21/37] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:34.273815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfef08c-9b70-41c6-a113-7a73235d9ce6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.274113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfef08c-9b70-41c6-a113-7a73235d9ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.274397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfef08c-9b70-41c6-a113-7a73235d9ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.296696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-adfef08c-9b70-41c6-a113-7a73235d9ce6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:34.299609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 17/38] 10.222.0.74 () {58 vars in 1361 bytes} [Mon May 23 16:25:34 2022] PUT /identity/v3/domains/default/users/9f0fe22fa44447e8acda5720d7e2ffa6/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:34.299735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-adfef08c-9b70-41c6-a113-7a73235d9ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:34.305875 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff9ca-ba84-4708-8adb-d1c76608edf7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.306169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff9ca-ba84-4708-8adb-d1c76608edf7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.306948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff9ca-ba84-4708-8adb-d1c76608edf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.348243 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b20ff9ca-ba84-4708-8adb-d1c76608edf7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:34.350972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b20ff9ca-ba84-4708-8adb-d1c76608edf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:34.409134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 22/39] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:34.410611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9446a2-7488-4ad0-95f7-87a3cf1970e0 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.410912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9446a2-7488-4ad0-95f7-87a3cf1970e0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.411205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9446a2-7488-4ad0-95f7-87a3cf1970e0 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.414642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:34.416984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 23/40] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:34.418640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faee84-cbfc-42cd-bb22-f563834f74f3 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.418943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faee84-cbfc-42cd-bb22-f563834f74f3 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.419232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faee84-cbfc-42cd-bb22-f563834f74f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.438392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-05faee84-cbfc-42cd-bb22-f563834f74f3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:34.439614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-05faee84-cbfc-42cd-bb22-f563834f74f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:34.449211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 18/41] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:34.450258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ff9ca-ba84-4708-8adb-d1c76608edf7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:34.534083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 24/42] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:25:34.534928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faee84-cbfc-42cd-bb22-f563834f74f3 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:34.550092 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:34.584991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ff9ca-ba84-4708-8adb-d1c76608edf7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:34.634607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460739-9590-4c99-880d-5a7b9f087244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:34.635351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460739-9590-4c99-880d-5a7b9f087244 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.635702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460739-9590-4c99-880d-5a7b9f087244 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.636250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460739-9590-4c99-880d-5a7b9f087244 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.636795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49460739-9590-4c99-880d-5a7b9f087244 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:34.638211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49460739-9590-4c99-880d-5a7b9f087244 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:34.664245 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faee84-cbfc-42cd-bb22-f563834f74f3 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:34.701352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d2475-6846-4151-85c5-10d1de3784a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:34.702040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2475-6846-4151-85c5-10d1de3784a0 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.702632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2475-6846-4151-85c5-10d1de3784a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.702920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2475-6846-4151-85c5-10d1de3784a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.703735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d2475-6846-4151-85c5-10d1de3784a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:34.705314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d2475-6846-4151-85c5-10d1de3784a0 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:34.707919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 19/43] 10.222.0.74 () {60 vars in 1131 bytes} [Mon May 23 16:25:34 2022] POST /identity/v3/roles => generated 225 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:34.713063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460739-9590-4c99-880d-5a7b9f087244 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:34.754731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:34.795643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 25/44] 10.222.0.74 () {60 vars in 1131 bytes} [Mon May 23 16:25:34 2022] POST /identity/v3/roles => generated 223 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:34.848674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460739-9590-4c99-880d-5a7b9f087244 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:34.895326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469eb05-c301-4b4c-94f6-681fd836f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:34.896737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469eb05-c301-4b4c-94f6-681fd836f952 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:34.897208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469eb05-c301-4b4c-94f6-681fd836f952 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:34.897636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469eb05-c301-4b4c-94f6-681fd836f952 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:34.899169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469eb05-c301-4b4c-94f6-681fd836f952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:34.900965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469eb05-c301-4b4c-94f6-681fd836f952 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:34.904425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 20/45] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:34.910623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d2475-6846-4151-85c5-10d1de3784a0 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:34.990835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:35.030542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d2475-6846-4151-85c5-10d1de3784a0 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:35.066168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9dfdb-3077-4dc3-bd8e-20ca32e4c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:35.066764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9dfdb-3077-4dc3-bd8e-20ca32e4c5c4 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:35.067057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9dfdb-3077-4dc3-bd8e-20ca32e4c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:35.067340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9dfdb-3077-4dc3-bd8e-20ca32e4c5c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:35.068069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9dfdb-3077-4dc3-bd8e-20ca32e4c5c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:35.069601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9dfdb-3077-4dc3-bd8e-20ca32e4c5c4 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:35.164347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 26/46] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:25:34 2022] POST /identity/v3/projects => generated 312 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:36.664075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3e75e-453c-4811-a3b4-d84e5a9b858d None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:36.664624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3e75e-453c-4811-a3b4-d84e5a9b858d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:36.664710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3e75e-453c-4811-a3b4-d84e5a9b858d None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:36.666030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 21/47] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:36.672429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb10d-2ce8-48a6-a38e-8755666f7ec8 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:36.672857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb10d-2ce8-48a6-a38e-8755666f7ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:36.673033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb10d-2ce8-48a6-a38e-8755666f7ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:36.689888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-f03fb10d-2ce8-48a6-a38e-8755666f7ec8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:36.691070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f03fb10d-2ce8-48a6-a38e-8755666f7ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:36.757224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 27/48] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:36.780619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3e75e-453c-4811-a3b4-d84e5a9b858d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:36.878657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3e75e-453c-4811-a3b4-d84e5a9b858d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:36.880154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:36.912350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cdec2-5442-49e7-8c32-3c5c40f22998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:36.913138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cdec2-5442-49e7-8c32-3c5c40f22998 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:36.913420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cdec2-5442-49e7-8c32-3c5c40f22998 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:36.913697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cdec2-5442-49e7-8c32-3c5c40f22998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:36.923595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cdec2-5442-49e7-8c32-3c5c40f22998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-406cdec2-5442-49e7-8c32-3c5c40f22998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:36.931053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:36.932045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:36.933063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 22/49] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:25:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:36.938575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fb10d-2ce8-48a6-a38e-8755666f7ec8 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:36.987355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:37.039639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fb10d-2ce8-48a6-a38e-8755666f7ec8 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:37.072386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289c6e1-0f0f-4040-9248-9819928ea2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:37.073634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289c6e1-0f0f-4040-9248-9819928ea2ef None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:37.073952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289c6e1-0f0f-4040-9248-9819928ea2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:37.074230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289c6e1-0f0f-4040-9248-9819928ea2ef None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:37.074990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289c6e1-0f0f-4040-9248-9819928ea2ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:37.075297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289c6e1-0f0f-4040-9248-9819928ea2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:37.076735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289c6e1-0f0f-4040-9248-9819928ea2ef None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:37.085277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 28/50] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:37.091649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cdec2-5442-49e7-8c32-3c5c40f22998 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:37.189816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cdec2-5442-49e7-8c32-3c5c40f22998 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:37.228325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cec080-c857-4e7e-b786-0769c725c3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:37.229404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cec080-c857-4e7e-b786-0769c725c3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:37.229778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cec080-c857-4e7e-b786-0769c725c3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:37.230063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cec080-c857-4e7e-b786-0769c725c3b4 None admin] PATH_INFO: `/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:37.231266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cec080-c857-4e7e-b786-0769c725c3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=9f0fe22fa44447e8acda5720d7e2ffa6)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:37.232803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cec080-c857-4e7e-b786-0769c725c3b4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:37.234446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 23/51] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:37 2022] GET /identity/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:37.239799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289c6e1-0f0f-4040-9248-9819928ea2ef None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:37.345515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289c6e1-0f0f-4040-9248-9819928ea2ef None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:37.358593 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:37.379647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc250d3-9573-4c4e-a3c8-28eabdc44595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:37.380478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc250d3-9573-4c4e-a3c8-28eabdc44595 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:37.380770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc250d3-9573-4c4e-a3c8-28eabdc44595 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:37.381051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc250d3-9573-4c4e-a3c8-28eabdc44595 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:37.382228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc250d3-9573-4c4e-a3c8-28eabdc44595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:37.383691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc250d3-9573-4c4e-a3c8-28eabdc44595 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:37.386413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 29/52] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:37.391937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cec080-c857-4e7e-b786-0769c725c3b4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:37.423337 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:37.494354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cec080-c857-4e7e-b786-0769c725c3b4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:37.501886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708cbd0-9381-4180-9969-2fc0fb77039b None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:37.502250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708cbd0-9381-4180-9969-2fc0fb77039b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:37.502600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708cbd0-9381-4180-9969-2fc0fb77039b None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:37.504193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 30/53] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:25:37.508855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345e764-6e4a-48be-9e81-26b899fdb303 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:37.509158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345e764-6e4a-48be-9e81-26b899fdb303 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:37.509441 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345e764-6e4a-48be-9e81-26b899fdb303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:37.527253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-3345e764-6e4a-48be-9e81-26b899fdb303 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:37.528498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3345e764-6e4a-48be-9e81-26b899fdb303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:37.530052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c783c2-8f81-432e-9016-3070b3039984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:37.530719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c783c2-8f81-432e-9016-3070b3039984 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:37.531005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c783c2-8f81-432e-9016-3070b3039984 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:37.531291 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c783c2-8f81-432e-9016-3070b3039984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:37.532130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c783c2-8f81-432e-9016-3070b3039984 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.domain.id=default, user.id=9f0fe22fa44447e8acda5720d7e2ffa6) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:37.532483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c783c2-8f81-432e-9016-3070b3039984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:37.533950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c783c2-8f81-432e-9016-3070b3039984 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:37.540084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 24/54] 10.222.0.74 () {56 vars in 1322 bytes} [Mon May 23 16:25:37 2022] GET /identity/v3/role_assignments?user.id=9f0fe22fa44447e8acda5720d7e2ffa6&scope.domain.id=default&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:37.598499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 31/55] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:25:37.622049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c783c2-8f81-432e-9016-3070b3039984 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:37.722074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:37.729901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c783c2-8f81-432e-9016-3070b3039984 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:37.765105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3efa76-0fe0-4cfe-b580-54378aa07d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:37.765913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efa76-0fe0-4cfe-b580-54378aa07d8f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:37.766202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efa76-0fe0-4cfe-b580-54378aa07d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:37.766485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efa76-0fe0-4cfe-b580-54378aa07d8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:37.767674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3efa76-0fe0-4cfe-b580-54378aa07d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:37.769167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3efa76-0fe0-4cfe-b580-54378aa07d8f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:37.770794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 25/56] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:37.777587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345e764-6e4a-48be-9e81-26b899fdb303 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:37.877344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345e764-6e4a-48be-9e81-26b899fdb303 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:37.888052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:37.911094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7407cfe-3d86-4924-a740-1b1667ce8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:37.911758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407cfe-3d86-4924-a740-1b1667ce8580 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:37.912057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407cfe-3d86-4924-a740-1b1667ce8580 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:37.912369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407cfe-3d86-4924-a740-1b1667ce8580 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:37.913094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7407cfe-3d86-4924-a740-1b1667ce8580 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:37.914550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7407cfe-3d86-4924-a740-1b1667ce8580 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:37.991420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 32/57] 10.222.0.74 () {60 vars in 1140 bytes} [Mon May 23 16:25:37 2022] POST /identity/v3/projects => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:25:40.181841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ac5f3-d2da-4b2d-a841-6d5917ea1b8d None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:40.182996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ac5f3-d2da-4b2d-a841-6d5917ea1b8d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:40.183091 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ac5f3-d2da-4b2d-a841-6d5917ea1b8d None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:40.184491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 26/58] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:40.189604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cddd9d-9be7-4e3f-acd8-b79947a099bf None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:40.189990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cddd9d-9be7-4e3f-acd8-b79947a099bf None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:40.190183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cddd9d-9be7-4e3f-acd8-b79947a099bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:40.206885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-21cddd9d-9be7-4e3f-acd8-b79947a099bf None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:40.208080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-21cddd9d-9be7-4e3f-acd8-b79947a099bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:40.273844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 33/59] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:40.298951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ac5f3-d2da-4b2d-a841-6d5917ea1b8d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:40.398602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ac5f3-d2da-4b2d-a841-6d5917ea1b8d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:40.432812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ec266-f7c1-4896-9cd5-2bb99ba41fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:40.433536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ec266-f7c1-4896-9cd5-2bb99ba41fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:40.433824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ec266-f7c1-4896-9cd5-2bb99ba41fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:40.434103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ec266-f7c1-4896-9cd5-2bb99ba41fe9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:40.435291 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ec266-f7c1-4896-9cd5-2bb99ba41fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:40.436772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ec266-f7c1-4896-9cd5-2bb99ba41fe9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:40.438363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 27/60] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:40.443670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cddd9d-9be7-4e3f-acd8-b79947a099bf None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:40.530978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:40.539247 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cddd9d-9be7-4e3f-acd8-b79947a099bf None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:40.572822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb17f16-c435-4c6f-81d8-6e9c41e535bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:40.573687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb17f16-c435-4c6f-81d8-6e9c41e535bc None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:40.574193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb17f16-c435-4c6f-81d8-6e9c41e535bc None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:40.574641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb17f16-c435-4c6f-81d8-6e9c41e535bc None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:40.575714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb17f16-c435-4c6f-81d8-6e9c41e535bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:40.577268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb17f16-c435-4c6f-81d8-6e9c41e535bc None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:40.676274 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 34/61] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:25:40 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:43.958074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129f98-371b-4c8e-a059-ac30274c45d2 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:43.958958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129f98-371b-4c8e-a059-ac30274c45d2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:43.959384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129f98-371b-4c8e-a059-ac30274c45d2 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:43.960967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 28/62] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:43.976209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069fba6-fbd4-4b0a-a315-36f5ebba47c1 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:43.976728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069fba6-fbd4-4b0a-a315-36f5ebba47c1 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:43.976823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069fba6-fbd4-4b0a-a315-36f5ebba47c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:43.998433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-4069fba6-fbd4-4b0a-a315-36f5ebba47c1 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:43.999664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4069fba6-fbd4-4b0a-a315-36f5ebba47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:44.098853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 35/63] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:44.140645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129f98-371b-4c8e-a059-ac30274c45d2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:44.186764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:44.294668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129f98-371b-4c8e-a059-ac30274c45d2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:44.306779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0361e89-c1a9-4ac0-a23f-ae85b2f9235c None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.307112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0361e89-c1a9-4ac0-a23f-ae85b2f9235c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.307350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0361e89-c1a9-4ac0-a23f-ae85b2f9235c None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.309153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 36/64] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:44.317017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb7df-caae-40e2-b165-f6e2f33e5cf0 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.317306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb7df-caae-40e2-b165-f6e2f33e5cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.317580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb7df-caae-40e2-b165-f6e2f33e5cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.337201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-886eb7df-caae-40e2-b165-f6e2f33e5cf0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:44.339794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-886eb7df-caae-40e2-b165-f6e2f33e5cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:44.360700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607e5ad-31eb-404c-89e9-cace7c786767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:44.362525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607e5ad-31eb-404c-89e9-cace7c786767 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.363144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607e5ad-31eb-404c-89e9-cace7c786767 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.364741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607e5ad-31eb-404c-89e9-cace7c786767 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.383070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607e5ad-31eb-404c-89e9-cace7c786767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-6607e5ad-31eb-404c-89e9-cace7c786767 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:44.392717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:44.393567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:44.394341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:44.405288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 29/65] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:44.411085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607e5ad-31eb-404c-89e9-cace7c786767 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:44.472400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 37/66] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:25:44.503659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f947-45e2-4e44-af64-3c533d593179 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.504470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f947-45e2-4e44-af64-3c533d593179 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.504950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f947-45e2-4e44-af64-3c533d593179 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.507038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 38/67] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:44.515301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b4d54-ca94-48ed-b337-069259d57b7a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.515859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b4d54-ca94-48ed-b337-069259d57b7a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.516352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b4d54-ca94-48ed-b337-069259d57b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.534997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-739b4d54-ca94-48ed-b337-069259d57b7a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:44.536264 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-739b4d54-ca94-48ed-b337-069259d57b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:44.538476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:44.559503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:44.568493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607e5ad-31eb-404c-89e9-cace7c786767 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:44.602937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac8cd4-c121-41e7-b381-1a1d84dea61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:44.604123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac8cd4-c121-41e7-b381-1a1d84dea61e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.604440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac8cd4-c121-41e7-b381-1a1d84dea61e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.604721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac8cd4-c121-41e7-b381-1a1d84dea61e None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.605517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac8cd4-c121-41e7-b381-1a1d84dea61e None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:44.605835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac8cd4-c121-41e7-b381-1a1d84dea61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:44.607279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac8cd4-c121-41e7-b381-1a1d84dea61e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:44.614722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 39/68] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:44.615952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 30/69] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:25:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:44.616455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830968bc-b101-4756-aa6b-590df46fa051 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.616927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830968bc-b101-4756-aa6b-590df46fa051 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.617024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac8cd4-c121-41e7-b381-1a1d84dea61e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:44.617546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830968bc-b101-4756-aa6b-590df46fa051 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.620029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 40/70] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:44.621718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830968bc-b101-4756-aa6b-590df46fa051 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:44.719077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac8cd4-c121-41e7-b381-1a1d84dea61e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:44.725027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830968bc-b101-4756-aa6b-590df46fa051 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:44.752537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a22ea-5c36-40fd-85d0-9463fd01b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:44.753327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a22ea-5c36-40fd-85d0-9463fd01b5ed None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.753611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a22ea-5c36-40fd-85d0-9463fd01b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.753899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a22ea-5c36-40fd-85d0-9463fd01b5ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.759697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5f5c6-3bf2-47a7-8a0c-4e932fcb368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:44.760699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5f5c6-3bf2-47a7-8a0c-4e932fcb368a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.760980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5f5c6-3bf2-47a7-8a0c-4e932fcb368a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.761254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5f5c6-3bf2-47a7-8a0c-4e932fcb368a None admin] PATH_INFO: `/v3/users/6814724561e444b7aab3949a44b38120` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.763949 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a22ea-5c36-40fd-85d0-9463fd01b5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:44.768469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-801a22ea-5c36-40fd-85d0-9463fd01b5ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:44.771782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:44.779111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 31/71] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:44.779934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974307-6086-40ec-874c-60f3d71ccdd4 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.780759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974307-6086-40ec-874c-60f3d71ccdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.780759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974307-6086-40ec-874c-60f3d71ccdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.780874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5f5c6-3bf2-47a7-8a0c-4e932fcb368a None admin] RBAC: Authorizing `identity:get_user(user_id=6814724561e444b7aab3949a44b38120)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:44.780874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5f5c6-3bf2-47a7-8a0c-4e932fcb368a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:44.781131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 41/72] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:44 2022] GET /identity/v3/users/6814724561e444b7aab3949a44b38120 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:44.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da0ef-7b96-4a7e-ac6e-d0d3fc7e286c None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.782629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da0ef-7b96-4a7e-ac6e-d0d3fc7e286c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.782904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da0ef-7b96-4a7e-ac6e-d0d3fc7e286c None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.784211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 42/73] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:44.788905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5da0ef-7b96-4a7e-ac6e-d0d3fc7e286c None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:44.796779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4b974307-6086-40ec-874c-60f3d71ccdd4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:44.797977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4b974307-6086-40ec-874c-60f3d71ccdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:44.805607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:44.863559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 32/74] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:44.864427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974307-6086-40ec-874c-60f3d71ccdd4 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:44.893516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5da0ef-7b96-4a7e-ac6e-d0d3fc7e286c None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:44.926899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bce000-1e5b-4b21-a38b-d9a6d7d55c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:44.927690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bce000-1e5b-4b21-a38b-d9a6d7d55c99 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.927977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bce000-1e5b-4b21-a38b-d9a6d7d55c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.928254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bce000-1e5b-4b21-a38b-d9a6d7d55c99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.929443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bce000-1e5b-4b21-a38b-d9a6d7d55c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:44.930904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bce000-1e5b-4b21-a38b-d9a6d7d55c99 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:44.933072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 43/75] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:44.937168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bce000-1e5b-4b21-a38b-d9a6d7d55c99 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:44.968199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974307-6086-40ec-874c-60f3d71ccdd4 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:44.998073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:45.002390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a34d-e8f3-4283-a33a-de18f6df13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.003143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a34d-e8f3-4283-a33a-de18f6df13f9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.003431 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a34d-e8f3-4283-a33a-de18f6df13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.003706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a34d-e8f3-4283-a33a-de18f6df13f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.004482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a34d-e8f3-4283-a33a-de18f6df13f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:45.004804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a34d-e8f3-4283-a33a-de18f6df13f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.006230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a34d-e8f3-4283-a33a-de18f6df13f9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.015358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 33/76] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:45.016580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b8b1-88d9-4e08-bdf4-70fb50bc8c16 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.016867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b8b1-88d9-4e08-bdf4-70fb50bc8c16 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.017146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b8b1-88d9-4e08-bdf4-70fb50bc8c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.023987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:45.033958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7c49b8b1-88d9-4e08-bdf4-70fb50bc8c16 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:45.035124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7c49b8b1-88d9-4e08-bdf4-70fb50bc8c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:45.041280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bce000-1e5b-4b21-a38b-d9a6d7d55c99 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.077395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9376ca-446e-4622-9de8-03fa2efb04eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.078049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9376ca-446e-4622-9de8-03fa2efb04eb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.078349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9376ca-446e-4622-9de8-03fa2efb04eb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.078632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9376ca-446e-4622-9de8-03fa2efb04eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.101854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 34/77] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:45.112602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b8b1-88d9-4e08-bdf4-70fb50bc8c16 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.146832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9376ca-446e-4622-9de8-03fa2efb04eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.148340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9376ca-446e-4622-9de8-03fa2efb04eb None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.208676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:45.212515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b8b1-88d9-4e08-bdf4-70fb50bc8c16 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.247602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6f9b-6518-401f-b951-fbb0ba421ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.247804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 44/78] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:25:45.248480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6f9b-6518-401f-b951-fbb0ba421ded None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.248667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9376ca-446e-4622-9de8-03fa2efb04eb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.248758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6f9b-6518-401f-b951-fbb0ba421ded None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.249093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6f9b-6518-401f-b951-fbb0ba421ded None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.250971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:45.260455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb6f9b-6518-401f-b951-fbb0ba421ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-8feb6f9b-6518-401f-b951-fbb0ba421ded None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:45.268500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:45.269343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:45.270121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 35/79] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:45.271020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6f9b-6518-401f-b951-fbb0ba421ded None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.354388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9376ca-446e-4622-9de8-03fa2efb04eb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.370159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6f9b-6518-401f-b951-fbb0ba421ded None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.387600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb5410-9099-4287-a32a-1110931fc079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.388269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb5410-9099-4287-a32a-1110931fc079 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.388588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb5410-9099-4287-a32a-1110931fc079 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.388864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb5410-9099-4287-a32a-1110931fc079 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.389604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb5410-9099-4287-a32a-1110931fc079 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.391043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb5410-9099-4287-a32a-1110931fc079 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.404322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e00c0c-3e6f-44e5-89bc-9c68d405e465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.405185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e00c0c-3e6f-44e5-89bc-9c68d405e465 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.405467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e00c0c-3e6f-44e5-89bc-9c68d405e465 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.405742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e00c0c-3e6f-44e5-89bc-9c68d405e465 None admin] PATH_INFO: `/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.406926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e00c0c-3e6f-44e5-89bc-9c68d405e465 None admin] RBAC: Authorizing `identity:get_user(user_id=9f0fe22fa44447e8acda5720d7e2ffa6)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.408406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e00c0c-3e6f-44e5-89bc-9c68d405e465 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.413534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 36/80] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:45.413534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e00c0c-3e6f-44e5-89bc-9c68d405e465 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.448266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 45/81] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:25:45 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:45.449763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb5410-9099-4287-a32a-1110931fc079 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.472324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:45.490051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:45.514233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e00c0c-3e6f-44e5-89bc-9c68d405e465 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.554783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267b235-1b37-43e9-84cd-7211f0bcf837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.555623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b235-1b37-43e9-84cd-7211f0bcf837 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.555913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b235-1b37-43e9-84cd-7211f0bcf837 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.556200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b235-1b37-43e9-84cd-7211f0bcf837 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.568469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267b235-1b37-43e9-84cd-7211f0bcf837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-4267b235-1b37-43e9-84cd-7211f0bcf837 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:45.577616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:45.578518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 37/82] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:45.584547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267b235-1b37-43e9-84cd-7211f0bcf837 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.589011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb5410-9099-4287-a32a-1110931fc079 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.628035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38a641-2dbe-42b1-b65d-264dd0520f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.628963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a641-2dbe-42b1-b65d-264dd0520f1e None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.629255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a641-2dbe-42b1-b65d-264dd0520f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.629536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a641-2dbe-42b1-b65d-264dd0520f1e None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.630801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38a641-2dbe-42b1-b65d-264dd0520f1e None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.632334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38a641-2dbe-42b1-b65d-264dd0520f1e None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.634488 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 46/83] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:45.635731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38a641-2dbe-42b1-b65d-264dd0520f1e None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.704722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267b235-1b37-43e9-84cd-7211f0bcf837 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.769701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:45.772237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:45.785657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38a641-2dbe-42b1-b65d-264dd0520f1e None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.789008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27917d9-2498-4154-94ce-7cf57887bffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.792836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27917d9-2498-4154-94ce-7cf57887bffd None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.793135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27917d9-2498-4154-94ce-7cf57887bffd None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.793421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27917d9-2498-4154-94ce-7cf57887bffd None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.794207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27917d9-2498-4154-94ce-7cf57887bffd None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:45.794529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27917d9-2498-4154-94ce-7cf57887bffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.797876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27917d9-2498-4154-94ce-7cf57887bffd None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.809169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 38/84] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:45.809169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27917d9-2498-4154-94ce-7cf57887bffd None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.831170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3509a49-f194-42d9-94ae-d5a48501c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.831855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509a49-f194-42d9-94ae-d5a48501c932 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.832127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509a49-f194-42d9-94ae-d5a48501c932 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.833307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509a49-f194-42d9-94ae-d5a48501c932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.909627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509a49-f194-42d9-94ae-d5a48501c932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.911121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509a49-f194-42d9-94ae-d5a48501c932 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.946362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27917d9-2498-4154-94ce-7cf57887bffd None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.985722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a99de2-b1c3-4c98-845a-25a624e1be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.986492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a99de2-b1c3-4c98-845a-25a624e1be26 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.986783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a99de2-b1c3-4c98-845a-25a624e1be26 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.987162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a99de2-b1c3-4c98-845a-25a624e1be26 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.987918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a99de2-b1c3-4c98-845a-25a624e1be26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:45.988224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a99de2-b1c3-4c98-845a-25a624e1be26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.989636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a99de2-b1c3-4c98-845a-25a624e1be26 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.999302 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 39/85] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:45.999951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a99de2-b1c3-4c98-845a-25a624e1be26 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.017027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:46.035501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 47/86] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:25:46.036380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3509a49-f194-42d9-94ae-d5a48501c932 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.057415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:46.122516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a99de2-b1c3-4c98-845a-25a624e1be26 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.161139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731504b-ca3e-4d00-a420-f13da78c2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.162074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731504b-ca3e-4d00-a420-f13da78c2e69 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.162371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731504b-ca3e-4d00-a420-f13da78c2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.163087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731504b-ca3e-4d00-a420-f13da78c2e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.164221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731504b-ca3e-4d00-a420-f13da78c2e69 None admin] RBAC: Adding query filter params (role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=07ec6eba37f64872812e5e3802a57be0, user.id=6814724561e444b7aab3949a44b38120) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:46.164566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731504b-ca3e-4d00-a420-f13da78c2e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.165613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3509a49-f194-42d9-94ae-d5a48501c932 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.166069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731504b-ca3e-4d00-a420-f13da78c2e69 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.173704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 40/87] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/role_assignments?user.id=6814724561e444b7aab3949a44b38120&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:46.175154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731504b-ca3e-4d00-a420-f13da78c2e69 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.278250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ba418-bf48-43f0-9783-ca02a0e2507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.288423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ba418-bf48-43f0-9783-ca02a0e2507d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.289130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ba418-bf48-43f0-9783-ca02a0e2507d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.289565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ba418-bf48-43f0-9783-ca02a0e2507d None admin] PATH_INFO: `/v3/users/6814724561e444b7aab3949a44b38120` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.297283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ba418-bf48-43f0-9783-ca02a0e2507d None admin] RBAC: Authorizing `identity:get_user(user_id=6814724561e444b7aab3949a44b38120)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.299031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ba418-bf48-43f0-9783-ca02a0e2507d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.303238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 48/88] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:46 2022] GET /identity/v3/users/6814724561e444b7aab3949a44b38120 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:46.316380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ba418-bf48-43f0-9783-ca02a0e2507d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.500671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:46.522358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731504b-ca3e-4d00-a420-f13da78c2e69 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.552753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:46.578987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ba418-bf48-43f0-9783-ca02a0e2507d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.579440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63395273-b350-4e40-9d58-baae842d2b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.587212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63395273-b350-4e40-9d58-baae842d2b5a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.587605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63395273-b350-4e40-9d58-baae842d2b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.587957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63395273-b350-4e40-9d58-baae842d2b5a None admin] PATH_INFO: `/v3/users/6814724561e444b7aab3949a44b38120` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.594256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63395273-b350-4e40-9d58-baae842d2b5a None admin] RBAC: Authorizing `identity:get_user(user_id=6814724561e444b7aab3949a44b38120)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.602169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63395273-b350-4e40-9d58-baae842d2b5a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.608715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 41/89] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:46 2022] GET /identity/v3/users/6814724561e444b7aab3949a44b38120 => generated 275 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:46.611078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63395273-b350-4e40-9d58-baae842d2b5a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.631616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa9b7-9d23-4ae8-a567-fbbe16173ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.632899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa9b7-9d23-4ae8-a567-fbbe16173ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.633386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa9b7-9d23-4ae8-a567-fbbe16173ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.633927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa9b7-9d23-4ae8-a567-fbbe16173ab2 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.635865 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa9b7-9d23-4ae8-a567-fbbe16173ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.639075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa9b7-9d23-4ae8-a567-fbbe16173ab2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.648127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 49/90] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:46 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:46.650008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa9b7-9d23-4ae8-a567-fbbe16173ab2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.814608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa9b7-9d23-4ae8-a567-fbbe16173ab2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.837044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63395273-b350-4e40-9d58-baae842d2b5a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.843429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:46.865793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716798-5c7c-4c70-af75-65ebd0e28a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.866472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716798-5c7c-4c70-af75-65ebd0e28a24 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.866765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716798-5c7c-4c70-af75-65ebd0e28a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.867047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716798-5c7c-4c70-af75-65ebd0e28a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.910269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83bebc-49ca-49dd-b242-1186306b10c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.910939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83bebc-49ca-49dd-b242-1186306b10c7 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.911233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83bebc-49ca-49dd-b242-1186306b10c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.911517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83bebc-49ca-49dd-b242-1186306b10c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:47.008682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b716798-5c7c-4c70-af75-65ebd0e28a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:47.010226 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b716798-5c7c-4c70-af75-65ebd0e28a24 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:47.015002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:47.068586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83bebc-49ca-49dd-b242-1186306b10c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:47.070000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83bebc-49ca-49dd-b242-1186306b10c7 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:47.122687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 50/91] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:25:47.123521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716798-5c7c-4c70-af75-65ebd0e28a24 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:47.148976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:47.261258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716798-5c7c-4c70-af75-65ebd0e28a24 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:47.295644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 42/92] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:25:47.296615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83bebc-49ca-49dd-b242-1186306b10c7 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:47.346967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5e0ed-4d18-47fd-98b4-eb78923b8147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:47.347554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5e0ed-4d18-47fd-98b4-eb78923b8147 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:47.347845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5e0ed-4d18-47fd-98b4-eb78923b8147 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:47.348127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5e0ed-4d18-47fd-98b4-eb78923b8147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:47.349006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5e0ed-4d18-47fd-98b4-eb78923b8147 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=07ec6eba37f64872812e5e3802a57be0, user.id=9f0fe22fa44447e8acda5720d7e2ffa6) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:47.349322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5e0ed-4d18-47fd-98b4-eb78923b8147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:47.350794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5e0ed-4d18-47fd-98b4-eb78923b8147 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:47.373312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 51/93] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:25:47 2022] GET /identity/v3/role_assignments?user.id=9f0fe22fa44447e8acda5720d7e2ffa6&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:47.374169 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5e0ed-4d18-47fd-98b4-eb78923b8147 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:47.414804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:47.441655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83bebc-49ca-49dd-b242-1186306b10c7 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:47.488017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2f24b-51d7-4a44-b9ed-e91a4cfc4c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:47.489731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2f24b-51d7-4a44-b9ed-e91a4cfc4c1b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:47.490017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2f24b-51d7-4a44-b9ed-e91a4cfc4c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:47.490295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2f24b-51d7-4a44-b9ed-e91a4cfc4c1b None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:47.493812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2f24b-51d7-4a44-b9ed-e91a4cfc4c1b None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:47.496068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2f24b-51d7-4a44-b9ed-e91a4cfc4c1b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:47.499422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 43/94] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:47 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:47.505545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2f24b-51d7-4a44-b9ed-e91a4cfc4c1b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:47.570143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:47.606632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5e0ed-4d18-47fd-98b4-eb78923b8147 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:47.673295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2f24b-51d7-4a44-b9ed-e91a4cfc4c1b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:47.683949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb767d3e-b4c6-4acc-87e9-0df9bc223bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:47.685194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767d3e-b4c6-4acc-87e9-0df9bc223bbb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:47.685653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767d3e-b4c6-4acc-87e9-0df9bc223bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:47.686075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767d3e-b4c6-4acc-87e9-0df9bc223bbb None admin] PATH_INFO: `/v3/projects/e4ebc64f52054cc8ad2d632f8bb1d3ee` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:47.687561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb767d3e-b4c6-4acc-87e9-0df9bc223bbb None admin] RBAC: Authorizing `identity:get_project(project_id=e4ebc64f52054cc8ad2d632f8bb1d3ee)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:47.689254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb767d3e-b4c6-4acc-87e9-0df9bc223bbb None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:47.691507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 52/95] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:47 2022] GET /identity/v3/projects/e4ebc64f52054cc8ad2d632f8bb1d3ee => generated 312 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:47.698653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb767d3e-b4c6-4acc-87e9-0df9bc223bbb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:47.746758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b353d3-b020-4bf7-bba1-0b31fe3c7068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:47.747752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b353d3-b020-4bf7-bba1-0b31fe3c7068 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:47.749076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b353d3-b020-4bf7-bba1-0b31fe3c7068 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:47.750237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b353d3-b020-4bf7-bba1-0b31fe3c7068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:47.751409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b353d3-b020-4bf7-bba1-0b31fe3c7068 None admin] RBAC: Adding query filter params (role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=07ec6eba37f64872812e5e3802a57be0, user.id=6814724561e444b7aab3949a44b38120) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:47.753051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b353d3-b020-4bf7-bba1-0b31fe3c7068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:47.755246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b353d3-b020-4bf7-bba1-0b31fe3c7068 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:47.768877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 44/96] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:25:47 2022] GET /identity/v3/role_assignments?user.id=6814724561e444b7aab3949a44b38120&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:47.847673 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb767d3e-b4c6-4acc-87e9-0df9bc223bbb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:47.893398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802967-7aec-4fb0-a458-be04de910127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:47.894415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802967-7aec-4fb0-a458-be04de910127 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:47.894902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802967-7aec-4fb0-a458-be04de910127 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:47.895620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802967-7aec-4fb0-a458-be04de910127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:47.896721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b802967-7aec-4fb0-a458-be04de910127 None admin] RBAC: Adding query filter params (role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=e4ebc64f52054cc8ad2d632f8bb1d3ee, user.id=6814724561e444b7aab3949a44b38120) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:47.897268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b802967-7aec-4fb0-a458-be04de910127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:47.898956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b802967-7aec-4fb0-a458-be04de910127 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:47.908677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 53/97] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:25:47 2022] GET /identity/v3/role_assignments?user.id=6814724561e444b7aab3949a44b38120&scope.project.id=e4ebc64f52054cc8ad2d632f8bb1d3ee&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:48.247201 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858dce-7051-47f8-9df8-c94ae84723d5 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:48.248212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858dce-7051-47f8-9df8-c94ae84723d5 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:48.248720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858dce-7051-47f8-9df8-c94ae84723d5 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:48.250388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 45/98] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:48.256369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4da489-7d2a-4545-afbd-b35eaedd243e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:48.257334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4da489-7d2a-4545-afbd-b35eaedd243e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:48.257832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4da489-7d2a-4545-afbd-b35eaedd243e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:48.278781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6f4da489-7d2a-4545-afbd-b35eaedd243e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:48.280396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6f4da489-7d2a-4545-afbd-b35eaedd243e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:48.301892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:48.367785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 54/99] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:48.403294 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06858dce-7051-47f8-9df8-c94ae84723d5 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:48.416851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:48.475378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686375f-2307-4d4c-b4d0-ac4b76a90797 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:48.475990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686375f-2307-4d4c-b4d0-ac4b76a90797 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:48.476503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686375f-2307-4d4c-b4d0-ac4b76a90797 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:48.478162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 55/100] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:25:48.484006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf5522-491b-4cad-98ee-2c3c02a08bc6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:48.484323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf5522-491b-4cad-98ee-2c3c02a08bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:48.484618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf5522-491b-4cad-98ee-2c3c02a08bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:48.515698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-50bf5522-491b-4cad-98ee-2c3c02a08bc6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:48.516945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-50bf5522-491b-4cad-98ee-2c3c02a08bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:48.587202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06858dce-7051-47f8-9df8-c94ae84723d5 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:48.664518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 56/101] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:25:48.676258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4e325-b533-4660-a17a-3e63ebdf1b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:48.677283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4e325-b533-4660-a17a-3e63ebdf1b20 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:48.677643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4e325-b533-4660-a17a-3e63ebdf1b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:48.678072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4e325-b533-4660-a17a-3e63ebdf1b20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:48.699534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4e325-b533-4660-a17a-3e63ebdf1b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:48.702658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf5522-491b-4cad-98ee-2c3c02a08bc6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-2ab4e325-b533-4660-a17a-3e63ebdf1b20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:48.707562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:48.708519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:48.709273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 46/102] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:48.717651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4e325-b533-4660-a17a-3e63ebdf1b20 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:48.879086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:48.915090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:48.930303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4e325-b533-4660-a17a-3e63ebdf1b20 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:48.956423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf5522-491b-4cad-98ee-2c3c02a08bc6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:49.019921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff0df6-a2c0-4da3-91d6-ca6b3e511673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:49.021126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff0df6-a2c0-4da3-91d6-ca6b3e511673 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:49.021561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff0df6-a2c0-4da3-91d6-ca6b3e511673 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:49.022013 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff0df6-a2c0-4da3-91d6-ca6b3e511673 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:49.022915 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff0df6-a2c0-4da3-91d6-ca6b3e511673 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:49.023389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff0df6-a2c0-4da3-91d6-ca6b3e511673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:49.024973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff0df6-a2c0-4da3-91d6-ca6b3e511673 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:49.034861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 47/103] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:25:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:49.037433 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a97d9-a68c-4a25-ada0-20aa3f127510 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:49.038342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a97d9-a68c-4a25-ada0-20aa3f127510 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:49.039221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a97d9-a68c-4a25-ada0-20aa3f127510 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:49.042585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 48/104] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:49.044049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866e52-28f8-4b02-9cee-978dacfd07c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:49.045044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866e52-28f8-4b02-9cee-978dacfd07c9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:49.045477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866e52-28f8-4b02-9cee-978dacfd07c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:49.045921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866e52-28f8-4b02-9cee-978dacfd07c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:49.047501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866e52-28f8-4b02-9cee-978dacfd07c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:49.048410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a97d9-a68c-4a25-ada0-20aa3f127510 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:49.050035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866e52-28f8-4b02-9cee-978dacfd07c9 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:49.054858 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 57/105] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:49.056250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d868-cfd4-4668-860b-031acd16b006 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:49.058763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d868-cfd4-4668-860b-031acd16b006 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:49.059200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d868-cfd4-4668-860b-031acd16b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:49.090018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2af2d868-cfd4-4668-860b-031acd16b006 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:49.092224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2af2d868-cfd4-4668-860b-031acd16b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:49.235215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 58/106] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:49.236380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2d868-cfd4-4668-860b-031acd16b006 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:49.270661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a97d9-a68c-4a25-ada0-20aa3f127510 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:49.313273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:49.318607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53450610-e4b3-4b26-91ef-de72395d3aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:49.319885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53450610-e4b3-4b26-91ef-de72395d3aeb None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:49.320336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53450610-e4b3-4b26-91ef-de72395d3aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:49.320758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53450610-e4b3-4b26-91ef-de72395d3aeb None admin] PATH_INFO: `/v3/users/8f667cf8923347dc903c889a5d5b1dcf` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:49.337179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53450610-e4b3-4b26-91ef-de72395d3aeb None admin] RBAC: Authorizing `identity:get_user(user_id=8f667cf8923347dc903c889a5d5b1dcf)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:49.340071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53450610-e4b3-4b26-91ef-de72395d3aeb None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:49.342773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 49/107] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:49 2022] GET /identity/v3/users/8f667cf8923347dc903c889a5d5b1dcf => generated 289 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:49.343789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53450610-e4b3-4b26-91ef-de72395d3aeb None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:49.356749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:49.402926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2d868-cfd4-4668-860b-031acd16b006 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:49.470489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53450610-e4b3-4b26-91ef-de72395d3aeb None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:49.473028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13eaf-7aea-4491-ba96-f99f0cc7bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:49.473719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13eaf-7aea-4491-ba96-f99f0cc7bfbc None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:49.474171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13eaf-7aea-4491-ba96-f99f0cc7bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:49.474597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13eaf-7aea-4491-ba96-f99f0cc7bfbc None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:49.475462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13eaf-7aea-4491-ba96-f99f0cc7bfbc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:49.477133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13eaf-7aea-4491-ba96-f99f0cc7bfbc None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:49.511244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664a47a-4ee7-4269-b9f6-8a0babd91590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:49.512559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664a47a-4ee7-4269-b9f6-8a0babd91590 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:49.512997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664a47a-4ee7-4269-b9f6-8a0babd91590 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:49.513421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664a47a-4ee7-4269-b9f6-8a0babd91590 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:49.525812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664a47a-4ee7-4269-b9f6-8a0babd91590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-7664a47a-4ee7-4269-b9f6-8a0babd91590 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:49.534238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:49.537186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:49.538138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 50/108] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:49.539539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664a47a-4ee7-4269-b9f6-8a0babd91590 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:49.578267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 59/109] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:25:49 2022] POST /identity/v3/projects => generated 302 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:49.579123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13eaf-7aea-4491-ba96-f99f0cc7bfbc None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:49.606264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:49.659722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664a47a-4ee7-4269-b9f6-8a0babd91590 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:49.702278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859fa8-a0c7-4aac-8a5f-830f45a5e8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:49.703262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859fa8-a0c7-4aac-8a5f-830f45a5e8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:49.703757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859fa8-a0c7-4aac-8a5f-830f45a5e8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:49.704183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859fa8-a0c7-4aac-8a5f-830f45a5e8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:49.830099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13eaf-7aea-4491-ba96-f99f0cc7bfbc None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:49.883344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:49.898940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f091-88a0-4be7-aed0-cc952896b8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:49.908426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f091-88a0-4be7-aed0-cc952896b8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:49.908426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f091-88a0-4be7-aed0-cc952896b8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:49.908426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f091-88a0-4be7-aed0-cc952896b8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:49.908426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7f091-88a0-4be7-aed0-cc952896b8e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:49.908426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7f091-88a0-4be7-aed0-cc952896b8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:49.908426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7f091-88a0-4be7-aed0-cc952896b8e0 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:49.921458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 60/110] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:25:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:49.927158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f091-88a0-4be7-aed0-cc952896b8e0 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:49.936552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33859fa8-a0c7-4aac-8a5f-830f45a5e8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:49.938243 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33859fa8-a0c7-4aac-8a5f-830f45a5e8b0 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:50.021908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:50.092388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 51/111] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:25:50.099026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859fa8-a0c7-4aac-8a5f-830f45a5e8b0 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:50.121025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f091-88a0-4be7-aed0-cc952896b8e0 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:50.206104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c660205-7d8d-485a-be64-7e27f19fe7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:50.207070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c660205-7d8d-485a-be64-7e27f19fe7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:50.207367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c660205-7d8d-485a-be64-7e27f19fe7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:50.207647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c660205-7d8d-485a-be64-7e27f19fe7f7 None admin] PATH_INFO: `/v3/users/6814724561e444b7aab3949a44b38120` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:50.208731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859fa8-a0c7-4aac-8a5f-830f45a5e8b0 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:50.208908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c660205-7d8d-485a-be64-7e27f19fe7f7 None admin] RBAC: Authorizing `identity:get_user(user_id=6814724561e444b7aab3949a44b38120)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:50.210391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c660205-7d8d-485a-be64-7e27f19fe7f7 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:50.223634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 61/112] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:49 2022] GET /identity/v3/users/6814724561e444b7aab3949a44b38120 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:50.229394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c660205-7d8d-485a-be64-7e27f19fe7f7 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:50.252844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5afd-cda2-401e-bf1d-aba179adaef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:50.254226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5afd-cda2-401e-bf1d-aba179adaef6 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:50.255946 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5afd-cda2-401e-bf1d-aba179adaef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:50.257207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5afd-cda2-401e-bf1d-aba179adaef6 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:50.263933 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f5afd-cda2-401e-bf1d-aba179adaef6 None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:50.266809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f5afd-cda2-401e-bf1d-aba179adaef6 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:50.269490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 52/113] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:50 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:50.281164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5afd-cda2-401e-bf1d-aba179adaef6 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:50.321031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:50.359359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:50.457255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c660205-7d8d-485a-be64-7e27f19fe7f7 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:50.520007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e93f28-7916-4e51-bbf9-d140ff3dcb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:50.521385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e93f28-7916-4e51-bbf9-d140ff3dcb83 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:50.521683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e93f28-7916-4e51-bbf9-d140ff3dcb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:50.521968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e93f28-7916-4e51-bbf9-d140ff3dcb83 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:50.528007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e93f28-7916-4e51-bbf9-d140ff3dcb83 None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:50.529591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e93f28-7916-4e51-bbf9-d140ff3dcb83 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:50.531484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 62/114] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:50 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:50.536597 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5afd-cda2-401e-bf1d-aba179adaef6 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:50.544221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e93f28-7916-4e51-bbf9-d140ff3dcb83 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:50.633126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aa56b-266b-443c-a824-7b9b159a55e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:50.633728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa56b-266b-443c-a824-7b9b159a55e9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:50.634015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa56b-266b-443c-a824-7b9b159a55e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:50.635033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa56b-266b-443c-a824-7b9b159a55e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:50.635748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa56b-266b-443c-a824-7b9b159a55e9 None admin] RBAC: Adding query filter params (role.id=d1262c94c63242cfa4dbc33ff60ac8dd, scope.project.id=07ec6eba37f64872812e5e3802a57be0, user.id=8f667cf8923347dc903c889a5d5b1dcf) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:50.636066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa56b-266b-443c-a824-7b9b159a55e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:50.637569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa56b-266b-443c-a824-7b9b159a55e9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:50.648733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 53/115] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:25:50 2022] GET /identity/v3/role_assignments?user.id=8f667cf8923347dc903c889a5d5b1dcf&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=d1262c94c63242cfa4dbc33ff60ac8dd => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:50.723124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e93f28-7916-4e51-bbf9-d140ff3dcb83 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:50.763578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:50.773995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e4e83-a369-4b78-8f9c-abb3691125aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:50.775088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e4e83-a369-4b78-8f9c-abb3691125aa None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:50.776439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e4e83-a369-4b78-8f9c-abb3691125aa None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:50.776736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e4e83-a369-4b78-8f9c-abb3691125aa None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0/users/6814724561e444b7aab3949a44b38120/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:50.779064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e4e83-a369-4b78-8f9c-abb3691125aa None admin] RBAC: Authorizing `identity:create_grant(project_id=07ec6eba37f64872812e5e3802a57be0, user_id=6814724561e444b7aab3949a44b38120, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:50.780684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e4e83-a369-4b78-8f9c-abb3691125aa None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:50.790798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324d23-9c11-42ab-a784-b27183701669 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:50.791135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324d23-9c11-42ab-a784-b27183701669 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:50.791372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324d23-9c11-42ab-a784-b27183701669 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:50.793007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 54/116] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:25:50.800882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1998837-b459-4c70-ac83-323f3e600884 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:50.801174 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1998837-b459-4c70-ac83-323f3e600884 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:50.801458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1998837-b459-4c70-ac83-323f3e600884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:50.831043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b1998837-b459-4c70-ac83-323f3e600884 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:50.832256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b1998837-b459-4c70-ac83-323f3e600884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:50.887475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 63/117] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:25:50 2022] PUT /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0/users/6814724561e444b7aab3949a44b38120/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:50.913843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa250684-ab70-41b3-86f8-e55038edf029 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:50.914179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa250684-ab70-41b3-86f8-e55038edf029 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:50.914433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa250684-ab70-41b3-86f8-e55038edf029 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:50.917438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 64/118] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:50.926918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 55/119] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:25:50.944885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6521a3-aea6-495c-953f-82ecb96fac37 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:50.945215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6521a3-aea6-495c-953f-82ecb96fac37 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:50.945528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6521a3-aea6-495c-953f-82ecb96fac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:50.971557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1998837-b459-4c70-ac83-323f3e600884 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:50.974819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-ef6521a3-aea6-495c-953f-82ecb96fac37 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:50.976086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ef6521a3-aea6-495c-953f-82ecb96fac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:51.006998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:51.074031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 65/120] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:51.105229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6521a3-aea6-495c-953f-82ecb96fac37 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:51.206928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1998837-b459-4c70-ac83-323f3e600884 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:51.253821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd22cbe-ddf5-42f1-8005-87e78c0f6430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:51.254814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd22cbe-ddf5-42f1-8005-87e78c0f6430 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.255102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd22cbe-ddf5-42f1-8005-87e78c0f6430 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.256163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd22cbe-ddf5-42f1-8005-87e78c0f6430 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.269896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd22cbe-ddf5-42f1-8005-87e78c0f6430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-9bd22cbe-ddf5-42f1-8005-87e78c0f6430 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:51.281176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:51.282468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 56/121] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:25:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:25:51.284760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69396224-3929-4672-b32a-8a2bc11b5854 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.286716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69396224-3929-4672-b32a-8a2bc11b5854 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.286716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69396224-3929-4672-b32a-8a2bc11b5854 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.286921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 57/122] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:51.294859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371890-69a1-416a-8386-513d06ddc9dd None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.295305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371890-69a1-416a-8386-513d06ddc9dd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.295697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371890-69a1-416a-8386-513d06ddc9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.296027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6521a3-aea6-495c-953f-82ecb96fac37 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:51.313770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-38371890-69a1-416a-8386-513d06ddc9dd None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:51.315999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-38371890-69a1-416a-8386-513d06ddc9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:51.316113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:51.335676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70754013-b48b-4ff8-a271-6731c5595259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:51.338146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70754013-b48b-4ff8-a271-6731c5595259 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.338146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70754013-b48b-4ff8-a271-6731c5595259 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.338146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70754013-b48b-4ff8-a271-6731c5595259 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.349388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70754013-b48b-4ff8-a271-6731c5595259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-70754013-b48b-4ff8-a271-6731c5595259 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:51.358450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:51.361564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 66/123] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:51.363573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70754013-b48b-4ff8-a271-6731c5595259 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:51.390464 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 58/124] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:25:51.391331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38371890-69a1-416a-8386-513d06ddc9dd None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:51.402106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:51.474196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70754013-b48b-4ff8-a271-6731c5595259 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:51.512789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089a9b0-1d90-4e76-afbd-2d9a071b6b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:51.513703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089a9b0-1d90-4e76-afbd-2d9a071b6b78 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.514009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089a9b0-1d90-4e76-afbd-2d9a071b6b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.514680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089a9b0-1d90-4e76-afbd-2d9a071b6b78 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.515717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089a9b0-1d90-4e76-afbd-2d9a071b6b78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:51.516033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089a9b0-1d90-4e76-afbd-2d9a071b6b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:51.517366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38371890-69a1-416a-8386-513d06ddc9dd None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:51.517478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089a9b0-1d90-4e76-afbd-2d9a071b6b78 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:51.532499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 67/125] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:25:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:51.533933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089a9b0-1d90-4e76-afbd-2d9a071b6b78 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:51.573115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292151-c9a0-4eb4-9f8d-d554e2f0a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:51.573866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292151-c9a0-4eb4-9f8d-d554e2f0a37f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.574155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292151-c9a0-4eb4-9f8d-d554e2f0a37f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.574438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292151-c9a0-4eb4-9f8d-d554e2f0a37f None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.575264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a292151-c9a0-4eb4-9f8d-d554e2f0a37f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:51.575576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a292151-c9a0-4eb4-9f8d-d554e2f0a37f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:51.577089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a292151-c9a0-4eb4-9f8d-d554e2f0a37f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:51.588904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:51.601603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 59/126] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:51.602477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292151-c9a0-4eb4-9f8d-d554e2f0a37f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:51.695712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:51.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089a9b0-1d90-4e76-afbd-2d9a071b6b78 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:51.744750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292151-c9a0-4eb4-9f8d-d554e2f0a37f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:51.773276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc16ded-6f4b-4e0c-8619-5b3e133ee843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:51.783708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc16ded-6f4b-4e0c-8619-5b3e133ee843 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.783708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc16ded-6f4b-4e0c-8619-5b3e133ee843 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.783708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc16ded-6f4b-4e0c-8619-5b3e133ee843 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.783960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5633-7f7d-4c2f-a9de-cc763d2798d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:51.783960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5633-7f7d-4c2f-a9de-cc763d2798d0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.783960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5633-7f7d-4c2f-a9de-cc763d2798d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.783960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5633-7f7d-4c2f-a9de-cc763d2798d0 None admin] PATH_INFO: `/v3/users/6814724561e444b7aab3949a44b38120` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.784232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c5633-7f7d-4c2f-a9de-cc763d2798d0 None admin] RBAC: Authorizing `identity:get_user(user_id=6814724561e444b7aab3949a44b38120)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:51.785049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c5633-7f7d-4c2f-a9de-cc763d2798d0 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:51.786136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 60/127] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:51 2022] GET /identity/v3/users/6814724561e444b7aab3949a44b38120 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:51.789516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5633-7f7d-4c2f-a9de-cc763d2798d0 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:51.806946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc16ded-6f4b-4e0c-8619-5b3e133ee843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-2fc16ded-6f4b-4e0c-8619-5b3e133ee843 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:51.822065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:51.823186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:25:51.825059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 68/128] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:51.828325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc16ded-6f4b-4e0c-8619-5b3e133ee843 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:51.929404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5633-7f7d-4c2f-a9de-cc763d2798d0 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:51.963140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:51.971531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03e6cd-d49b-4061-8cf9-f879ecc15395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:51.978743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03e6cd-d49b-4061-8cf9-f879ecc15395 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.978743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03e6cd-d49b-4061-8cf9-f879ecc15395 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.978743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03e6cd-d49b-4061-8cf9-f879ecc15395 None admin] PATH_INFO: `/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.978743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03e6cd-d49b-4061-8cf9-f879ecc15395 None admin] RBAC: Authorizing `identity:get_user(user_id=9f0fe22fa44447e8acda5720d7e2ffa6)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:51.978743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03e6cd-d49b-4061-8cf9-f879ecc15395 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:51.979703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 61/129] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:51 2022] GET /identity/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:51.980548 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03e6cd-d49b-4061-8cf9-f879ecc15395 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:52.066854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:52.072562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc16ded-6f4b-4e0c-8619-5b3e133ee843 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:52.129904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b833a7-bff1-4f88-b9b6-206500b484fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:52.130931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b833a7-bff1-4f88-b9b6-206500b484fe None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:52.131226 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b833a7-bff1-4f88-b9b6-206500b484fe None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:52.131511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b833a7-bff1-4f88-b9b6-206500b484fe None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:52.132754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b833a7-bff1-4f88-b9b6-206500b484fe None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:52.134866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b833a7-bff1-4f88-b9b6-206500b484fe None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:52.136747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 69/130] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:51 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:52.137689 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b833a7-bff1-4f88-b9b6-206500b484fe None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:52.170367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03e6cd-d49b-4061-8cf9-f879ecc15395 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:52.245018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f33e22-a2b9-45ea-b8fb-85b28cf7b4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:52.245716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f33e22-a2b9-45ea-b8fb-85b28cf7b4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:52.246011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f33e22-a2b9-45ea-b8fb-85b28cf7b4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:52.246297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f33e22-a2b9-45ea-b8fb-85b28cf7b4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:52.247062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f33e22-a2b9-45ea-b8fb-85b28cf7b4a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:52.247373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f33e22-a2b9-45ea-b8fb-85b28cf7b4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:52.248796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f33e22-a2b9-45ea-b8fb-85b28cf7b4a3 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:52.267570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 62/131] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:52.268196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f33e22-a2b9-45ea-b8fb-85b28cf7b4a3 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:52.287762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b833a7-bff1-4f88-b9b6-206500b484fe None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:52.330963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16d93-1e43-4ad7-bdd8-05645e1640ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:52.331756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16d93-1e43-4ad7-bdd8-05645e1640ad None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:52.332042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16d93-1e43-4ad7-bdd8-05645e1640ad None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:52.332333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16d93-1e43-4ad7-bdd8-05645e1640ad None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:52.333643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c16d93-1e43-4ad7-bdd8-05645e1640ad None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:52.335115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c16d93-1e43-4ad7-bdd8-05645e1640ad None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:52.344455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 70/132] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:52 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:52.345339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16d93-1e43-4ad7-bdd8-05645e1640ad None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:52.400671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:52.410529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:52.466227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f33e22-a2b9-45ea-b8fb-85b28cf7b4a3 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:52.526114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16d93-1e43-4ad7-bdd8-05645e1640ad None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:52.538158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e86c4-c921-467b-a745-4e6222512f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:52.539068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e86c4-c921-467b-a745-4e6222512f02 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:52.539353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e86c4-c921-467b-a745-4e6222512f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:52.539629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e86c4-c921-467b-a745-4e6222512f02 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0/users/6814724561e444b7aab3949a44b38120/roles/c07ef3c8c1574bb987c394026b04fb39` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:52.544916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e86c4-c921-467b-a745-4e6222512f02 None admin] RBAC: Authorizing `identity:create_grant(project_id=07ec6eba37f64872812e5e3802a57be0, user_id=6814724561e444b7aab3949a44b38120, role_id=c07ef3c8c1574bb987c394026b04fb39)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:52.546394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e86c4-c921-467b-a745-4e6222512f02 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:52.582291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bc4a9-c310-45b0-940a-fd80836f8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:52.583139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bc4a9-c310-45b0-940a-fd80836f8851 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:52.583433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bc4a9-c310-45b0-940a-fd80836f8851 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:52.583712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bc4a9-c310-45b0-940a-fd80836f8851 None admin] PATH_INFO: `/v3/users/6814724561e444b7aab3949a44b38120` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:52.584982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bc4a9-c310-45b0-940a-fd80836f8851 None admin] RBAC: Authorizing `identity:get_user(user_id=6814724561e444b7aab3949a44b38120)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:52.586453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bc4a9-c310-45b0-940a-fd80836f8851 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:52.588899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 71/133] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:52 2022] GET /identity/v3/users/6814724561e444b7aab3949a44b38120 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:52.589572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bc4a9-c310-45b0-940a-fd80836f8851 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:52.647307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 63/134] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:25:52 2022] PUT /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0/users/6814724561e444b7aab3949a44b38120/roles/c07ef3c8c1574bb987c394026b04fb39 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:52.648248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e86c4-c921-467b-a745-4e6222512f02 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:52.702203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bc4a9-c310-45b0-940a-fd80836f8851 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:52.705161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:52.742708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d761-a276-4ba6-989f-b36e355df268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:52.743763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d761-a276-4ba6-989f-b36e355df268 None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:52.744053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d761-a276-4ba6-989f-b36e355df268 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:52.744355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d761-a276-4ba6-989f-b36e355df268 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0/users/9f0fe22fa44447e8acda5720d7e2ffa6/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:52.746539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7d761-a276-4ba6-989f-b36e355df268 None admin] RBAC: Authorizing `identity:create_grant(project_id=07ec6eba37f64872812e5e3802a57be0, user_id=9f0fe22fa44447e8acda5720d7e2ffa6, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:52.748085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7d761-a276-4ba6-989f-b36e355df268 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:52.808464 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e86c4-c921-467b-a745-4e6222512f02 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:52.824067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 72/135] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:25:52 2022] PUT /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0/users/9f0fe22fa44447e8acda5720d7e2ffa6/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:52.836117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:52.849584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ceee2-852f-477e-b2d6-451e7208ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:52.850456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ceee2-852f-477e-b2d6-451e7208ef51 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:52.850745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ceee2-852f-477e-b2d6-451e7208ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:52.851120 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ceee2-852f-477e-b2d6-451e7208ef51 None admin] PATH_INFO: `/v3/projects/e4ebc64f52054cc8ad2d632f8bb1d3ee` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:52.852452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ceee2-852f-477e-b2d6-451e7208ef51 None admin] RBAC: Authorizing `identity:get_project(project_id=e4ebc64f52054cc8ad2d632f8bb1d3ee)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:52.854628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ceee2-852f-477e-b2d6-451e7208ef51 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:52.856449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 64/136] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:52 2022] GET /identity/v3/projects/e4ebc64f52054cc8ad2d632f8bb1d3ee => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:52.862578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d761-a276-4ba6-989f-b36e355df268 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:53.030252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d761-a276-4ba6-989f-b36e355df268 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:53.080004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8cb18-d8c5-4f1d-a2bb-c34614711092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:53.080964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8cb18-d8c5-4f1d-a2bb-c34614711092 None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.081255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8cb18-d8c5-4f1d-a2bb-c34614711092 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.081599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8cb18-d8c5-4f1d-a2bb-c34614711092 None admin] PATH_INFO: `/v3/projects/e4ebc64f52054cc8ad2d632f8bb1d3ee/users/6814724561e444b7aab3949a44b38120/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.086262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8cb18-d8c5-4f1d-a2bb-c34614711092 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4ebc64f52054cc8ad2d632f8bb1d3ee, user_id=6814724561e444b7aab3949a44b38120, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:53.088058 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8cb18-d8c5-4f1d-a2bb-c34614711092 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:53.162114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 73/137] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:25:52 2022] PUT /identity/v3/projects/e4ebc64f52054cc8ad2d632f8bb1d3ee/users/6814724561e444b7aab3949a44b38120/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:53.267441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67b9a6-a787-4dd9-a5e3-b9e6e0fd4cc4 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.267824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67b9a6-a787-4dd9-a5e3-b9e6e0fd4cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.268016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67b9a6-a787-4dd9-a5e3-b9e6e0fd4cc4 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.269480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 65/138] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:53.277555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70647-c9a2-483a-97dd-12ce642f12f2 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.278214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70647-c9a2-483a-97dd-12ce642f12f2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.278710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70647-c9a2-483a-97dd-12ce642f12f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.305559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-52b70647-c9a2-483a-97dd-12ce642f12f2 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:53.307828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-52b70647-c9a2-483a-97dd-12ce642f12f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:53.328624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:53.346287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf20e4-d085-4111-a2a1-267af5e660d9 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.346618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf20e4-d085-4111-a2a1-267af5e660d9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.346800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf20e4-d085-4111-a2a1-267af5e660d9 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.348210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 66/139] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:25:53.368439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ca907-575b-4b16-9315-5e867acf808d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.369419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ca907-575b-4b16-9315-5e867acf808d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.369610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ca907-575b-4b16-9315-5e867acf808d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.401885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-593ca907-575b-4b16-9315-5e867acf808d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:53.403869 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-593ca907-575b-4b16-9315-5e867acf808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:53.420630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 74/140] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:53.445904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70647-c9a2-483a-97dd-12ce642f12f2 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:53.490138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 67/141] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:53.547029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ca907-575b-4b16-9315-5e867acf808d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:53.564893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70647-c9a2-483a-97dd-12ce642f12f2 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:53.601211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100ec32-bbcf-4ad0-ac7c-7daafc1e82b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:53.601925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100ec32-bbcf-4ad0-ac7c-7daafc1e82b3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.602213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100ec32-bbcf-4ad0-ac7c-7daafc1e82b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.602493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100ec32-bbcf-4ad0-ac7c-7daafc1e82b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.604214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100ec32-bbcf-4ad0-ac7c-7daafc1e82b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:53.605702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100ec32-bbcf-4ad0-ac7c-7daafc1e82b3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:53.613471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 75/142] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:53.613471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100ec32-bbcf-4ad0-ac7c-7daafc1e82b3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:53.643582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:53.723728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100ec32-bbcf-4ad0-ac7c-7daafc1e82b3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:53.742476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ca907-575b-4b16-9315-5e867acf808d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:53.761238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4abbf-41f0-46aa-b1f7-aaac0b61d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:53.762016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4abbf-41f0-46aa-b1f7-aaac0b61d1e5 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.762369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4abbf-41f0-46aa-b1f7-aaac0b61d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.762649 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4abbf-41f0-46aa-b1f7-aaac0b61d1e5 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.763368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4abbf-41f0-46aa-b1f7-aaac0b61d1e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:53.764936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4abbf-41f0-46aa-b1f7-aaac0b61d1e5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:53.784843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:53.822668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95486722-4976-4566-b0c4-2d1ab701771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:53.823473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95486722-4976-4566-b0c4-2d1ab701771e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.823781 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95486722-4976-4566-b0c4-2d1ab701771e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.824066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95486722-4976-4566-b0c4-2d1ab701771e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.847288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95486722-4976-4566-b0c4-2d1ab701771e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-95486722-4976-4566-b0c4-2d1ab701771e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:53.855467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:53.856359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:25:53.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:53.864722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 68/143] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:53.865685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95486722-4976-4566-b0c4-2d1ab701771e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:53.869995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 76/144] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:25:53 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:25:54.010505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95486722-4976-4566-b0c4-2d1ab701771e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.059062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601be6ce-e6b6-4364-9ec1-715b3ceea8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.059750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601be6ce-e6b6-4364-9ec1-715b3ceea8bc None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.060030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601be6ce-e6b6-4364-9ec1-715b3ceea8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.060319 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601be6ce-e6b6-4364-9ec1-715b3ceea8bc None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.061157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601be6ce-e6b6-4364-9ec1-715b3ceea8bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:54.061478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601be6ce-e6b6-4364-9ec1-715b3ceea8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.062879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601be6ce-e6b6-4364-9ec1-715b3ceea8bc None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.072839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 69/145] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:25:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:54.083581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4abbf-41f0-46aa-b1f7-aaac0b61d1e5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.229152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:54.262526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4abbf-41f0-46aa-b1f7-aaac0b61d1e5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.304171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a25f0-1d40-4449-aac6-f4c745655980 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.304503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a25f0-1d40-4449-aac6-f4c745655980 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.305327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a25f0-1d40-4449-aac6-f4c745655980 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.308393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 70/146] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:25:54.315939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ce3c-12c8-47a5-a7bc-8882aebfd1f6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.316344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ce3c-12c8-47a5-a7bc-8882aebfd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.316538 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ce3c-12c8-47a5-a7bc-8882aebfd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.324245 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3665-2889-4f8a-9eb9-3981b1462be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.325157 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3665-2889-4f8a-9eb9-3981b1462be5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.325441 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3665-2889-4f8a-9eb9-3981b1462be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.325717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3665-2889-4f8a-9eb9-3981b1462be5 None admin] PATH_INFO: `/v3/users/8f667cf8923347dc903c889a5d5b1dcf` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.329664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c3665-2889-4f8a-9eb9-3981b1462be5 None admin] RBAC: Authorizing `identity:get_user(user_id=8f667cf8923347dc903c889a5d5b1dcf)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.331514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c3665-2889-4f8a-9eb9-3981b1462be5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.333536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 77/147] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:54 2022] GET /identity/v3/users/8f667cf8923347dc903c889a5d5b1dcf => generated 289 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:54.334195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-55e1ce3c-12c8-47a5-a7bc-8882aebfd1f6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:54.336543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-55e1ce3c-12c8-47a5-a7bc-8882aebfd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:54.345332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3665-2889-4f8a-9eb9-3981b1462be5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.401654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:54.463223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 71/148] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:25:54.490048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ce3c-12c8-47a5-a7bc-8882aebfd1f6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.536772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3665-2889-4f8a-9eb9-3981b1462be5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.577158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3384-673a-4ae0-b886-8d9310d7cd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.578030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3384-673a-4ae0-b886-8d9310d7cd2e None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.578319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3384-673a-4ae0-b886-8d9310d7cd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.578600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3384-673a-4ae0-b886-8d9310d7cd2e None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.579809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3384-673a-4ae0-b886-8d9310d7cd2e None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.581315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3384-673a-4ae0-b886-8d9310d7cd2e None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.583060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 78/149] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:54 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:54.590021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3384-673a-4ae0-b886-8d9310d7cd2e None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.614843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:54.659422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ce3c-12c8-47a5-a7bc-8882aebfd1f6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.702506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3384-673a-4ae0-b886-8d9310d7cd2e None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.712048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40d885-28c5-4b23-bc2d-37d21bb4fd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.713698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40d885-28c5-4b23-bc2d-37d21bb4fd1a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.714144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40d885-28c5-4b23-bc2d-37d21bb4fd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.714514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40d885-28c5-4b23-bc2d-37d21bb4fd1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.733889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40d885-28c5-4b23-bc2d-37d21bb4fd1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:54.740577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6740a-f8bb-4c81-a7be-d3283b454176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.741489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6740a-f8bb-4c81-a7be-d3283b454176 None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.741871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6740a-f8bb-4c81-a7be-d3283b454176 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.742226 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6740a-f8bb-4c81-a7be-d3283b454176 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0/users/8f667cf8923347dc903c889a5d5b1dcf/roles/d1262c94c63242cfa4dbc33ff60ac8dd` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.744968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6740a-f8bb-4c81-a7be-d3283b454176 None admin] RBAC: Authorizing `identity:create_grant(project_id=07ec6eba37f64872812e5e3802a57be0, user_id=8f667cf8923347dc903c889a5d5b1dcf, role_id=d1262c94c63242cfa4dbc33ff60ac8dd)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.746440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6740a-f8bb-4c81-a7be-d3283b454176 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-ae40d885-28c5-4b23-bc2d-37d21bb4fd1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:54.751238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:54.752136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:54.756689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 72/150] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:25:54.760504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40d885-28c5-4b23-bc2d-37d21bb4fd1a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.812689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:54.877641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40d885-28c5-4b23-bc2d-37d21bb4fd1a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.922714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 79/151] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:25:54 2022] PUT /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0/users/8f667cf8923347dc903c889a5d5b1dcf/roles/d1262c94c63242cfa4dbc33ff60ac8dd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:54.934481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecf24-4e9b-41ef-ab9f-eb80597be6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.935603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecf24-4e9b-41ef-ab9f-eb80597be6ba None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.936139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecf24-4e9b-41ef-ab9f-eb80597be6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.936656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecf24-4e9b-41ef-ab9f-eb80597be6ba None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.937687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ecf24-4e9b-41ef-ab9f-eb80597be6ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:54.938286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ecf24-4e9b-41ef-ab9f-eb80597be6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.939942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ecf24-4e9b-41ef-ab9f-eb80597be6ba None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.951835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 73/152] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:25:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:54.958110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6740a-f8bb-4c81-a7be-d3283b454176 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:55.060031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:55.088888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6740a-f8bb-4c81-a7be-d3283b454176 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:55.127297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62526-fc4e-4a20-a7f1-071de8cffe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:55.128286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62526-fc4e-4a20-a7f1-071de8cffe2b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.128615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62526-fc4e-4a20-a7f1-071de8cffe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.128896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62526-fc4e-4a20-a7f1-071de8cffe2b None admin] PATH_INFO: `/v3/users/6814724561e444b7aab3949a44b38120` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.130170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba62526-fc4e-4a20-a7f1-071de8cffe2b None admin] RBAC: Authorizing `identity:get_user(user_id=6814724561e444b7aab3949a44b38120)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:55.131859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba62526-fc4e-4a20-a7f1-071de8cffe2b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:55.133670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 80/153] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:54 2022] GET /identity/v3/users/6814724561e444b7aab3949a44b38120 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:55.139689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecf24-4e9b-41ef-ab9f-eb80597be6ba None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:55.262490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:55.275428 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecf24-4e9b-41ef-ab9f-eb80597be6ba None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:55.324407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797beb04-f098-4917-bb9b-221a055aa6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:55.325002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797beb04-f098-4917-bb9b-221a055aa6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.325288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797beb04-f098-4917-bb9b-221a055aa6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.325567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797beb04-f098-4917-bb9b-221a055aa6c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.411046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797beb04-f098-4917-bb9b-221a055aa6c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:55.412589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797beb04-f098-4917-bb9b-221a055aa6c7 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:55.529397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:55.538267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 74/154] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:25:55.544597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62526-fc4e-4a20-a7f1-071de8cffe2b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:55.686082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62526-fc4e-4a20-a7f1-071de8cffe2b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:55.725699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0db1-50c2-4bda-9426-5c6a7b3a3b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:55.726619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0db1-50c2-4bda-9426-5c6a7b3a3b67 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.726911 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0db1-50c2-4bda-9426-5c6a7b3a3b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.727190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0db1-50c2-4bda-9426-5c6a7b3a3b67 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.728527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d0db1-50c2-4bda-9426-5c6a7b3a3b67 None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:55.730000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d0db1-50c2-4bda-9426-5c6a7b3a3b67 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:55.732022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 81/155] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:55 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:55.741403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797beb04-f098-4917-bb9b-221a055aa6c7 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:55.880860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797beb04-f098-4917-bb9b-221a055aa6c7 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:55.920628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da557a1e-878a-4953-9dd8-98e15314ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:55.921297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da557a1e-878a-4953-9dd8-98e15314ed7b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.921579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da557a1e-878a-4953-9dd8-98e15314ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.921852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da557a1e-878a-4953-9dd8-98e15314ed7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.922703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da557a1e-878a-4953-9dd8-98e15314ed7b None admin] RBAC: Adding query filter params (role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=07ec6eba37f64872812e5e3802a57be0, user.id=6814724561e444b7aab3949a44b38120) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:55.923014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da557a1e-878a-4953-9dd8-98e15314ed7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:55.924491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da557a1e-878a-4953-9dd8-98e15314ed7b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:55.933118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 75/156] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:25:55 2022] GET /identity/v3/role_assignments?user.id=6814724561e444b7aab3949a44b38120&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:56.051919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e258a-6781-47d1-9b53-9cdc3afe5fc1 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.052287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e258a-6781-47d1-9b53-9cdc3afe5fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.052530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e258a-6781-47d1-9b53-9cdc3afe5fc1 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.054088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 82/157] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:56.059874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a046ff-cdbc-4039-8722-821c0c0b4cd3 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.060156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a046ff-cdbc-4039-8722-821c0c0b4cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.060469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a046ff-cdbc-4039-8722-821c0c0b4cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.081076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-79a046ff-cdbc-4039-8722-821c0c0b4cd3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:56.082291 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-79a046ff-cdbc-4039-8722-821c0c0b4cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:56.154651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:56.169806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 76/158] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:56.213895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e258a-6781-47d1-9b53-9cdc3afe5fc1 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:56.226731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:56.323723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e258a-6781-47d1-9b53-9cdc3afe5fc1 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:56.368160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc24aa-95bd-4665-8906-86bb3aae9839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:56.370538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc24aa-95bd-4665-8906-86bb3aae9839 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.370538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc24aa-95bd-4665-8906-86bb3aae9839 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.370538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc24aa-95bd-4665-8906-86bb3aae9839 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.383526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc24aa-95bd-4665-8906-86bb3aae9839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-14cc24aa-95bd-4665-8906-86bb3aae9839 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:56.392411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:56.393332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:25:56.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 83/159] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:25:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:56.403225 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a046ff-cdbc-4039-8722-821c0c0b4cd3 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:56.457363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de71a-e61d-4595-b9d2-6f1fce0ef83c None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.457670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de71a-e61d-4595-b9d2-6f1fce0ef83c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.457923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de71a-e61d-4595-b9d2-6f1fce0ef83c None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.459302 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 84/160] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:25:56.474085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426bd5-1406-4fc5-945b-a46f8bcb761d None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.474374 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426bd5-1406-4fc5-945b-a46f8bcb761d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.474636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426bd5-1406-4fc5-945b-a46f8bcb761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.498627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-19426bd5-1406-4fc5-945b-a46f8bcb761d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:56.500629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-19426bd5-1406-4fc5-945b-a46f8bcb761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:56.569691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a046ff-cdbc-4039-8722-821c0c0b4cd3 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:56.619144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:56.624199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 85/161] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:25:56.641938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec114c8-c236-4ec8-b1eb-bb5c8dfbf8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:56.642855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec114c8-c236-4ec8-b1eb-bb5c8dfbf8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.643306 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec114c8-c236-4ec8-b1eb-bb5c8dfbf8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.643719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec114c8-c236-4ec8-b1eb-bb5c8dfbf8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.644638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec114c8-c236-4ec8-b1eb-bb5c8dfbf8c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:56.645348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec114c8-c236-4ec8-b1eb-bb5c8dfbf8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:56.646878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec114c8-c236-4ec8-b1eb-bb5c8dfbf8c8 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:56.649263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426bd5-1406-4fc5-945b-a46f8bcb761d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:56.659830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 77/162] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:25:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:56.665918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec114c8-c236-4ec8-b1eb-bb5c8dfbf8c8 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:56.760258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:56.827935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426bd5-1406-4fc5-945b-a46f8bcb761d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:56.850125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec114c8-c236-4ec8-b1eb-bb5c8dfbf8c8 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:56.882205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22a5fa-de28-4043-8c2d-8b48faf7189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:56.883194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22a5fa-de28-4043-8c2d-8b48faf7189a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.883488 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22a5fa-de28-4043-8c2d-8b48faf7189a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.883768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22a5fa-de28-4043-8c2d-8b48faf7189a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.901760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22a5fa-de28-4043-8c2d-8b48faf7189a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-ff22a5fa-de28-4043-8c2d-8b48faf7189a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:56.911946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:56.912895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:25:56.913664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 86/163] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:25:56.914358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb857b24-4a9c-4863-9b1b-f797f80f4304 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.914358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb857b24-4a9c-4863-9b1b-f797f80f4304 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.914482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb857b24-4a9c-4863-9b1b-f797f80f4304 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.918586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa42e93-3ade-44aa-9227-1245a5556e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:56.919785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa42e93-3ade-44aa-9227-1245a5556e85 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.920262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa42e93-3ade-44aa-9227-1245a5556e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.920815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa42e93-3ade-44aa-9227-1245a5556e85 None admin] PATH_INFO: `/v3/users/6814724561e444b7aab3949a44b38120` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.924627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 87/164] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:56.925345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb857b24-4a9c-4863-9b1b-f797f80f4304 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:56.925634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa42e93-3ade-44aa-9227-1245a5556e85 None admin] RBAC: Authorizing `identity:get_user(user_id=6814724561e444b7aab3949a44b38120)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:56.927461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa42e93-3ade-44aa-9227-1245a5556e85 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:56.929928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 78/165] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:56 2022] GET /identity/v3/users/6814724561e444b7aab3949a44b38120 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:56.931566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf36eba-bd72-4e2b-8037-8ab53650047f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.932074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf36eba-bd72-4e2b-8037-8ab53650047f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.932595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf36eba-bd72-4e2b-8037-8ab53650047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.963898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7bf36eba-bd72-4e2b-8037-8ab53650047f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:56.965124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7bf36eba-bd72-4e2b-8037-8ab53650047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:57.082815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:57.095916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 79/166] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:57.096650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf36eba-bd72-4e2b-8037-8ab53650047f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.169098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb857b24-4a9c-4863-9b1b-f797f80f4304 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.200746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:57.225765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b7413-6672-4ecf-b315-ed7dd5629405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.226636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b7413-6672-4ecf-b315-ed7dd5629405 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.226935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b7413-6672-4ecf-b315-ed7dd5629405 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.227240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b7413-6672-4ecf-b315-ed7dd5629405 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.228428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b7413-6672-4ecf-b315-ed7dd5629405 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:57.228742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b7413-6672-4ecf-b315-ed7dd5629405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.230138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b7413-6672-4ecf-b315-ed7dd5629405 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.248039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 88/167] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:57.248927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b7413-6672-4ecf-b315-ed7dd5629405 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.303796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf36eba-bd72-4e2b-8037-8ab53650047f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.373935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b7413-6672-4ecf-b315-ed7dd5629405 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.383208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bd44-553a-4de1-9dba-c6a255daba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.384413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bd44-553a-4de1-9dba-c6a255daba2c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.384706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bd44-553a-4de1-9dba-c6a255daba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.385121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bd44-553a-4de1-9dba-c6a255daba2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.397758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:57.429496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c7ede-276f-47a1-9c73-42ca03f30dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.431370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c7ede-276f-47a1-9c73-42ca03f30dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.436680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c7ede-276f-47a1-9c73-42ca03f30dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.436971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c7ede-276f-47a1-9c73-42ca03f30dd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.458975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c7ede-276f-47a1-9c73-42ca03f30dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-cd7c7ede-276f-47a1-9c73-42ca03f30dd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:57.466912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:57.467804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:25:57.469067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 89/168] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:57.471785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c7ede-276f-47a1-9c73-42ca03f30dd7 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.505391 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268bd44-553a-4de1-9dba-c6a255daba2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.506937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268bd44-553a-4de1-9dba-c6a255daba2c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.615937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:57.643250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c7ede-276f-47a1-9c73-42ca03f30dd7 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.709750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 80/169] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:25:57.712238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bd44-553a-4de1-9dba-c6a255daba2c None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.715048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9b6f8-3452-4ccc-a59f-2b96a53544f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.716203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9b6f8-3452-4ccc-a59f-2b96a53544f8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.716727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9b6f8-3452-4ccc-a59f-2b96a53544f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.717202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9b6f8-3452-4ccc-a59f-2b96a53544f8 None admin] PATH_INFO: `/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.718915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9b6f8-3452-4ccc-a59f-2b96a53544f8 None admin] RBAC: Authorizing `identity:get_user(user_id=9f0fe22fa44447e8acda5720d7e2ffa6)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.720947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9b6f8-3452-4ccc-a59f-2b96a53544f8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.727397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 90/170] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:57 2022] GET /identity/v3/users/9f0fe22fa44447e8acda5720d7e2ffa6 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:57.728690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9b6f8-3452-4ccc-a59f-2b96a53544f8 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.816168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:57.888011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9b6f8-3452-4ccc-a59f-2b96a53544f8 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.910974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bd44-553a-4de1-9dba-c6a255daba2c None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.951552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6a45f-3af8-4ff2-be07-cb610b9434d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.952844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6a45f-3af8-4ff2-be07-cb610b9434d3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.953336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6a45f-3af8-4ff2-be07-cb610b9434d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.953812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6a45f-3af8-4ff2-be07-cb610b9434d3 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.956795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6a45f-3af8-4ff2-be07-cb610b9434d3 None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.958512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6a45f-3af8-4ff2-be07-cb610b9434d3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.961424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 91/171] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:57 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:57.964121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6a45f-3af8-4ff2-be07-cb610b9434d3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.990245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0663f-586f-4257-9145-e423f357c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.991067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0663f-586f-4257-9145-e423f357c009 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.991360 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0663f-586f-4257-9145-e423f357c009 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.991637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0663f-586f-4257-9145-e423f357c009 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.992446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0663f-586f-4257-9145-e423f357c009 None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:57.995838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0663f-586f-4257-9145-e423f357c009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.995838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0663f-586f-4257-9145-e423f357c009 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.008726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 81/172] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:25:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:58.010380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0663f-586f-4257-9145-e423f357c009 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.040987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:58.182135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0663f-586f-4257-9145-e423f357c009 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.227042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6a45f-3af8-4ff2-be07-cb610b9434d3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.262598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:58.264457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8737-6a70-4603-a0b8-2a1165dcd3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.265130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8737-6a70-4603-a0b8-2a1165dcd3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.265414 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8737-6a70-4603-a0b8-2a1165dcd3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.265691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8737-6a70-4603-a0b8-2a1165dcd3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.266536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f8737-6a70-4603-a0b8-2a1165dcd3a4 None admin] RBAC: Adding query filter params (role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=07ec6eba37f64872812e5e3802a57be0, user.id=6814724561e444b7aab3949a44b38120) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:58.266849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f8737-6a70-4603-a0b8-2a1165dcd3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.269111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f8737-6a70-4603-a0b8-2a1165dcd3a4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.281585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 82/173] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:25:58 2022] GET /identity/v3/role_assignments?user.id=6814724561e444b7aab3949a44b38120&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:58.282906 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8737-6a70-4603-a0b8-2a1165dcd3a4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.297928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f3da0-b724-482f-8906-b609df074a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.298721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3da0-b724-482f-8906-b609df074a09 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.298983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3da0-b724-482f-8906-b609df074a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.299267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3da0-b724-482f-8906-b609df074a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.450950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:58.468836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f3da0-b724-482f-8906-b609df074a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.470563 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f3da0-b724-482f-8906-b609df074a09 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.496018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8737-6a70-4603-a0b8-2a1165dcd3a4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.545120 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53dfc4-482e-42e7-8543-912fc5cd0233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.546245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53dfc4-482e-42e7-8543-912fc5cd0233 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.546709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53dfc4-482e-42e7-8543-912fc5cd0233 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.547140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53dfc4-482e-42e7-8543-912fc5cd0233 None admin] PATH_INFO: `/v3/users/6814724561e444b7aab3949a44b38120` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.548570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53dfc4-482e-42e7-8543-912fc5cd0233 None admin] RBAC: Authorizing `identity:get_user(user_id=6814724561e444b7aab3949a44b38120)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.550339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53dfc4-482e-42e7-8543-912fc5cd0233 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.552191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 83/174] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:25:58 2022] GET /identity/v3/users/6814724561e444b7aab3949a44b38120 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:58.563223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53dfc4-482e-42e7-8543-912fc5cd0233 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.696989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 92/175] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:25:58.715422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f3da0-b724-482f-8906-b609df074a09 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.724004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53dfc4-482e-42e7-8543-912fc5cd0233 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.757686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:58.772660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1277b-9f0f-4156-ba69-237baaa243e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.773720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1277b-9f0f-4156-ba69-237baaa243e5 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.774186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1277b-9f0f-4156-ba69-237baaa243e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.774745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1277b-9f0f-4156-ba69-237baaa243e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.796984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:58.876683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1277b-9f0f-4156-ba69-237baaa243e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.878688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1277b-9f0f-4156-ba69-237baaa243e5 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.998383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f3da0-b724-482f-8906-b609df074a09 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:59.026079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 84/176] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:25:59.037608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1277b-9f0f-4156-ba69-237baaa243e5 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:59.066399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78f7b5-7c36-447e-9609-2685063c007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:59.067364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78f7b5-7c36-447e-9609-2685063c007e None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.067718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78f7b5-7c36-447e-9609-2685063c007e None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.068063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78f7b5-7c36-447e-9609-2685063c007e None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.073137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78f7b5-7c36-447e-9609-2685063c007e None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:59.080319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78f7b5-7c36-447e-9609-2685063c007e None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:59.080319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 93/177] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:58 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:59.093367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78f7b5-7c36-447e-9609-2685063c007e None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:59.129901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:59.200324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1277b-9f0f-4156-ba69-237baaa243e5 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:59.237020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e140e2a-6f39-498f-ac3c-aab7cd92f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:59.237877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e140e2a-6f39-498f-ac3c-aab7cd92f507 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.238162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e140e2a-6f39-498f-ac3c-aab7cd92f507 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.238440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e140e2a-6f39-498f-ac3c-aab7cd92f507 None admin] PATH_INFO: `/v3/projects/e4ebc64f52054cc8ad2d632f8bb1d3ee` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.239621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e140e2a-6f39-498f-ac3c-aab7cd92f507 None admin] RBAC: Authorizing `identity:get_project(project_id=e4ebc64f52054cc8ad2d632f8bb1d3ee)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:59.241175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e140e2a-6f39-498f-ac3c-aab7cd92f507 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:59.241578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:59.247640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 85/178] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:25:59 2022] GET /identity/v3/projects/e4ebc64f52054cc8ad2d632f8bb1d3ee => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:59.247640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4a0d8-991b-4506-9167-26af19a45c7f None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.247640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4a0d8-991b-4506-9167-26af19a45c7f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.247640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4a0d8-991b-4506-9167-26af19a45c7f None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.247640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 86/179] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:59.248013 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba9e8e-d47c-48ed-95c6-ed68dd9d46fd None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.254274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba9e8e-d47c-48ed-95c6-ed68dd9d46fd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.254274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba9e8e-d47c-48ed-95c6-ed68dd9d46fd None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.254274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 87/180] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:59.254274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a989ef-3f27-4fa2-8069-927adc9dd79a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.254274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a989ef-3f27-4fa2-8069-927adc9dd79a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.254274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a989ef-3f27-4fa2-8069-927adc9dd79a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.254274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 88/181] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:59.254729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a989ef-3f27-4fa2-8069-927adc9dd79a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:59.266646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78f7b5-7c36-447e-9609-2685063c007e None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:59.308600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151b04-1723-48d5-9a95-a23ad0db5378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:59.309294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151b04-1723-48d5-9a95-a23ad0db5378 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.309582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151b04-1723-48d5-9a95-a23ad0db5378 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.310197 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151b04-1723-48d5-9a95-a23ad0db5378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.311059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151b04-1723-48d5-9a95-a23ad0db5378 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=07ec6eba37f64872812e5e3802a57be0, user.id=9f0fe22fa44447e8acda5720d7e2ffa6) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:59.311376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151b04-1723-48d5-9a95-a23ad0db5378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:59.313026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151b04-1723-48d5-9a95-a23ad0db5378 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:59.319588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 94/182] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:25:59 2022] GET /identity/v3/role_assignments?user.id=9f0fe22fa44447e8acda5720d7e2ffa6&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:59.326385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635fbd7-d61c-4d7d-bb90-880c73c8ea6a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.327454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635fbd7-d61c-4d7d-bb90-880c73c8ea6a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.327962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635fbd7-d61c-4d7d-bb90-880c73c8ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.350818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-1635fbd7-d61c-4d7d-bb90-880c73c8ea6a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:59.352529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1635fbd7-d61c-4d7d-bb90-880c73c8ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:59.390002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a989ef-3f27-4fa2-8069-927adc9dd79a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:59.403742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:59.435538 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095e4e5-d32a-4625-96ea-6c5a406a7001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:59.437265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e4e5-d32a-4625-96ea-6c5a406a7001 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.438026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e4e5-d32a-4625-96ea-6c5a406a7001 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.438458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e4e5-d32a-4625-96ea-6c5a406a7001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.439745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e4e5-d32a-4625-96ea-6c5a406a7001 None admin] RBAC: Adding query filter params (role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=e4ebc64f52054cc8ad2d632f8bb1d3ee, user.id=6814724561e444b7aab3949a44b38120) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:59.440565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e4e5-d32a-4625-96ea-6c5a406a7001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:59.441996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e4e5-d32a-4625-96ea-6c5a406a7001 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:59.448924 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 95/183] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:59.450739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac073b9-63b9-41b1-b3a0-0ed403212590 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.451235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac073b9-63b9-41b1-b3a0-0ed403212590 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.451762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac073b9-63b9-41b1-b3a0-0ed403212590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.456650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 89/184] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:25:59 2022] GET /identity/v3/role_assignments?user.id=6814724561e444b7aab3949a44b38120&scope.project.id=e4ebc64f52054cc8ad2d632f8bb1d3ee&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:59.458112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f92ab7-36c8-485e-91d9-410cbc0c52ca None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.458400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f92ab7-36c8-485e-91d9-410cbc0c52ca None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.458677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f92ab7-36c8-485e-91d9-410cbc0c52ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.474072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-dac073b9-63b9-41b1-b3a0-0ed403212590 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:59.476732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-dac073b9-63b9-41b1-b3a0-0ed403212590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:59.494179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-22f92ab7-36c8-485e-91d9-410cbc0c52ca None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:59.495383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-22f92ab7-36c8-485e-91d9-410cbc0c52ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:59.572998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 96/185] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:59.574178 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3e22-7186-4761-834f-2720e29617f2 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.574473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3e22-7186-4761-834f-2720e29617f2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.574755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3e22-7186-4761-834f-2720e29617f2 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.576665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 97/186] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:25:59.577326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd3e22-7186-4761-834f-2720e29617f2 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:59.591084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:59.592121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 90/187] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:59.597342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683027f-a1df-4211-a1a6-ec98feb87b63 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.597631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683027f-a1df-4211-a1a6-ec98feb87b63 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.597912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683027f-a1df-4211-a1a6-ec98feb87b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.632121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-3683027f-a1df-4211-a1a6-ec98feb87b63 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:59.633400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3683027f-a1df-4211-a1a6-ec98feb87b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:59.704366 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd3e22-7186-4761-834f-2720e29617f2 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:59.717884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 91/188] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:25:59.718766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683027f-a1df-4211-a1a6-ec98feb87b63 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:59.743252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a547a-9163-4353-b725-93dcde04fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:59.744104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a547a-9163-4353-b725-93dcde04fd88 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.744413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a547a-9163-4353-b725-93dcde04fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.744687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a547a-9163-4353-b725-93dcde04fd88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.745884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a547a-9163-4353-b725-93dcde04fd88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:59.747333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a547a-9163-4353-b725-93dcde04fd88 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:59.752438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 98/189] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:59.752438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a547a-9163-4353-b725-93dcde04fd88 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:59.807164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:59.851797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:59.872473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683027f-a1df-4211-a1a6-ec98feb87b63 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:59.873625 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a547a-9163-4353-b725-93dcde04fd88 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:59.905507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e255-e05b-4a85-b1f2-d4ac6b8b0dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:59.906310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e255-e05b-4a85-b1f2-d4ac6b8b0dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.906588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e255-e05b-4a85-b1f2-d4ac6b8b0dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.906860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735e255-e05b-4a85-b1f2-d4ac6b8b0dd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.907243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a51f52-f652-4bdd-abc4-22d331d28197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:59.908028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a51f52-f652-4bdd-abc4-22d331d28197 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.908328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a51f52-f652-4bdd-abc4-22d331d28197 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.908608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a51f52-f652-4bdd-abc4-22d331d28197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.916997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735e255-e05b-4a85-b1f2-d4ac6b8b0dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:59.919091 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a51f52-f652-4bdd-abc4-22d331d28197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-5735e255-e05b-4a85-b1f2-d4ac6b8b0dd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:59.925052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:59.926062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:25:59.926870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 92/190] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:25:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-29a51f52-f652-4bdd-abc4-22d331d28197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:25:59.927583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:25:59.928422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:25:59.929200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:25:59.929809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e255-e05b-4a85-b1f2-d4ac6b8b0dd5 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:59.929875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 99/191] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:25:59.929875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a51f52-f652-4bdd-abc4-22d331d28197 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.023986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:00.027511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a51f52-f652-4bdd-abc4-22d331d28197 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.031470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735e255-e05b-4a85-b1f2-d4ac6b8b0dd5 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.062274 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb1304-11d9-41e6-8f60-7b4d69c4c909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.062951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb1304-11d9-41e6-8f60-7b4d69c4c909 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.063237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb1304-11d9-41e6-8f60-7b4d69c4c909 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.063518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb1304-11d9-41e6-8f60-7b4d69c4c909 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.064228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb1304-11d9-41e6-8f60-7b4d69c4c909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.064862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f352b-34a2-48ed-b012-7d7e20d33918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.065658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f352b-34a2-48ed-b012-7d7e20d33918 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.065744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb1304-11d9-41e6-8f60-7b4d69c4c909 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.065943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f352b-34a2-48ed-b012-7d7e20d33918 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.066222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f352b-34a2-48ed-b012-7d7e20d33918 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.074657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:00.076646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f352b-34a2-48ed-b012-7d7e20d33918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-a03f352b-34a2-48ed-b012-7d7e20d33918 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:00.084405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:00.088438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 93/192] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:25:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:00.089285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f352b-34a2-48ed-b012-7d7e20d33918 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.156352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 100/193] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:25:59 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:00.157136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb1304-11d9-41e6-8f60-7b4d69c4c909 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.195434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f352b-34a2-48ed-b012-7d7e20d33918 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.244367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadaddd-a470-4774-9a28-033543bb3bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.245059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadaddd-a470-4774-9a28-033543bb3bdc None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.245353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadaddd-a470-4774-9a28-033543bb3bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.245634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadaddd-a470-4774-9a28-033543bb3bdc None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.246407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadaddd-a470-4774-9a28-033543bb3bdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:00.246719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadaddd-a470-4774-9a28-033543bb3bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.248200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadaddd-a470-4774-9a28-033543bb3bdc None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.258078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 94/194] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:00.259515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadaddd-a470-4774-9a28-033543bb3bdc None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.279443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:00.283653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb1304-11d9-41e6-8f60-7b4d69c4c909 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.321717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07d30-c9d7-4fc8-ac9b-63e919e60ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.322843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07d30-c9d7-4fc8-ac9b-63e919e60ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.323305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07d30-c9d7-4fc8-ac9b-63e919e60ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.323764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07d30-c9d7-4fc8-ac9b-63e919e60ff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.324756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a07d30-c9d7-4fc8-ac9b-63e919e60ff8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:00.325216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a07d30-c9d7-4fc8-ac9b-63e919e60ff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.326797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a07d30-c9d7-4fc8-ac9b-63e919e60ff8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.335862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 101/195] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:00.337151 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07d30-c9d7-4fc8-ac9b-63e919e60ff8 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.379246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadaddd-a470-4774-9a28-033543bb3bdc None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.402954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:00.422374 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a716-10bb-43f9-a594-40a7bd43e033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.423083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a716-10bb-43f9-a594-40a7bd43e033 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.423390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a716-10bb-43f9-a594-40a7bd43e033 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.423659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a716-10bb-43f9-a594-40a7bd43e033 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.425351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a716-10bb-43f9-a594-40a7bd43e033 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:00.425351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a716-10bb-43f9-a594-40a7bd43e033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.426334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a716-10bb-43f9-a594-40a7bd43e033 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.439247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 95/196] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:00.440189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a716-10bb-43f9-a594-40a7bd43e033 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.459762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07d30-c9d7-4fc8-ac9b-63e919e60ff8 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.504077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793449f-34b8-45d1-a047-9b460e8e3183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.504995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793449f-34b8-45d1-a047-9b460e8e3183 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.505278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793449f-34b8-45d1-a047-9b460e8e3183 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.505900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793449f-34b8-45d1-a047-9b460e8e3183 None admin] PATH_INFO: `/v3/users/f5991174fbc84416afae1daafbafac86` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.526198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793449f-34b8-45d1-a047-9b460e8e3183 None admin] RBAC: Authorizing `identity:get_user(user_id=f5991174fbc84416afae1daafbafac86)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.527853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793449f-34b8-45d1-a047-9b460e8e3183 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.530806 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 102/197] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/users/f5991174fbc84416afae1daafbafac86 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:00.531619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793449f-34b8-45d1-a047-9b460e8e3183 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.544614 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:00.568761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a716-10bb-43f9-a594-40a7bd43e033 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.608650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512473f-c493-479a-8836-80e916c02423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.609973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512473f-c493-479a-8836-80e916c02423 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.610441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512473f-c493-479a-8836-80e916c02423 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.610970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512473f-c493-479a-8836-80e916c02423 None admin] PATH_INFO: `/v3/users/f5991174fbc84416afae1daafbafac86` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.612505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512473f-c493-479a-8836-80e916c02423 None admin] RBAC: Authorizing `identity:get_user(user_id=f5991174fbc84416afae1daafbafac86)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.614388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512473f-c493-479a-8836-80e916c02423 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.616537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 96/198] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/users/f5991174fbc84416afae1daafbafac86 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:00.617559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512473f-c493-479a-8836-80e916c02423 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.648718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793449f-34b8-45d1-a047-9b460e8e3183 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.664251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:00.685903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b474ac-3a3a-46b3-bf81-9f4ef067128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.686633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b474ac-3a3a-46b3-bf81-9f4ef067128a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.687045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b474ac-3a3a-46b3-bf81-9f4ef067128a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.687217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b474ac-3a3a-46b3-bf81-9f4ef067128a None admin] PATH_INFO: `/v3/users/8f667cf8923347dc903c889a5d5b1dcf` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.688469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b474ac-3a3a-46b3-bf81-9f4ef067128a None admin] RBAC: Authorizing `identity:get_user(user_id=8f667cf8923347dc903c889a5d5b1dcf)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.690048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b474ac-3a3a-46b3-bf81-9f4ef067128a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.691961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 103/199] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/users/8f667cf8923347dc903c889a5d5b1dcf => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:00.692848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b474ac-3a3a-46b3-bf81-9f4ef067128a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.734820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512473f-c493-479a-8836-80e916c02423 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.776816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8fd6-20e5-4256-8c92-2388c5e2b5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.777870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8fd6-20e5-4256-8c92-2388c5e2b5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.778331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8fd6-20e5-4256-8c92-2388c5e2b5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.778779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8fd6-20e5-4256-8c92-2388c5e2b5c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.796693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:00.802289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b474ac-3a3a-46b3-bf81-9f4ef067128a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.839042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dc050-2803-4f1e-8fcc-37495db7033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.839738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc050-2803-4f1e-8fcc-37495db7033f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.840356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc050-2803-4f1e-8fcc-37495db7033f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.840356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc050-2803-4f1e-8fcc-37495db7033f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.857856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c8fd6-20e5-4256-8c92-2388c5e2b5c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.860249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c8fd6-20e5-4256-8c92-2388c5e2b5c9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.891385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:00.913528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dc050-2803-4f1e-8fcc-37495db7033f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.915388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dc050-2803-4f1e-8fcc-37495db7033f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.974746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 97/200] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:00.974746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8fd6-20e5-4256-8c92-2388c5e2b5c9 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.032083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:01.060383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 104/201] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:01.061308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dc050-2803-4f1e-8fcc-37495db7033f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.097473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8fd6-20e5-4256-8c92-2388c5e2b5c9 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.141047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42195e6-707c-47ce-9bce-e384d1f69c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.141827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42195e6-707c-47ce-9bce-e384d1f69c12 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.142183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42195e6-707c-47ce-9bce-e384d1f69c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.142532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42195e6-707c-47ce-9bce-e384d1f69c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.157217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:01.177705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dc050-2803-4f1e-8fcc-37495db7033f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.216778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42195e6-707c-47ce-9bce-e384d1f69c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.218100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42195e6-707c-47ce-9bce-e384d1f69c12 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.228899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcc2ec-1b8e-4812-9c18-438fedd34338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.230120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcc2ec-1b8e-4812-9c18-438fedd34338 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.230657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcc2ec-1b8e-4812-9c18-438fedd34338 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.231078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcc2ec-1b8e-4812-9c18-438fedd34338 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.232477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcc2ec-1b8e-4812-9c18-438fedd34338 None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.234319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcc2ec-1b8e-4812-9c18-438fedd34338 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.236610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 105/202] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:01 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:01.237738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcc2ec-1b8e-4812-9c18-438fedd34338 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.267198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:01.325166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 98/203] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:01.326124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42195e6-707c-47ce-9bce-e384d1f69c12 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.350579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcc2ec-1b8e-4812-9c18-438fedd34338 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.389245 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0543-2092-4990-b222-adeb686015f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.390585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0543-2092-4990-b222-adeb686015f3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.391124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0543-2092-4990-b222-adeb686015f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.391601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0543-2092-4990-b222-adeb686015f3 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.393038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec0543-2092-4990-b222-adeb686015f3 None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.395076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec0543-2092-4990-b222-adeb686015f3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.397077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 106/204] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:01 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:01.398121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0543-2092-4990-b222-adeb686015f3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.421248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:01.440039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42195e6-707c-47ce-9bce-e384d1f69c12 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.480138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696dec-15bd-47fd-9cdb-a0636ee6cd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.480767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696dec-15bd-47fd-9cdb-a0636ee6cd1e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.481054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696dec-15bd-47fd-9cdb-a0636ee6cd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.481330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696dec-15bd-47fd-9cdb-a0636ee6cd1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.482411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696dec-15bd-47fd-9cdb-a0636ee6cd1e None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=edc11b80eb824c8391530bc7bb78d27c, user.id=f5991174fbc84416afae1daafbafac86) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:01.482611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696dec-15bd-47fd-9cdb-a0636ee6cd1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.484085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696dec-15bd-47fd-9cdb-a0636ee6cd1e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.490484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 99/205] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:01 2022] GET /identity/v3/role_assignments?user.id=f5991174fbc84416afae1daafbafac86&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:01.491119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696dec-15bd-47fd-9cdb-a0636ee6cd1e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.505810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:01.527807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0543-2092-4990-b222-adeb686015f3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.591831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02977-5ade-40ce-83a2-373c14023fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.593101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02977-5ade-40ce-83a2-373c14023fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.593642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02977-5ade-40ce-83a2-373c14023fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.594250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02977-5ade-40ce-83a2-373c14023fe7 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.597911 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb02977-5ade-40ce-83a2-373c14023fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.599615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb02977-5ade-40ce-83a2-373c14023fe7 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.601810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 107/206] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:01 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:01.608250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02977-5ade-40ce-83a2-373c14023fe7 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.611090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696dec-15bd-47fd-9cdb-a0636ee6cd1e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.656111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f9d42-5ecc-4d77-b104-06686d7c839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.657698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f9d42-5ecc-4d77-b104-06686d7c839e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.657981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f9d42-5ecc-4d77-b104-06686d7c839e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.658257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f9d42-5ecc-4d77-b104-06686d7c839e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.659119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f9d42-5ecc-4d77-b104-06686d7c839e None admin] RBAC: Adding query filter params (role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=edc11b80eb824c8391530bc7bb78d27c, user.id=f5991174fbc84416afae1daafbafac86) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:01.659438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f9d42-5ecc-4d77-b104-06686d7c839e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f9d42-5ecc-4d77-b104-06686d7c839e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.676403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 100/207] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:01 2022] GET /identity/v3/role_assignments?user.id=f5991174fbc84416afae1daafbafac86&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:01.768138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:01.787778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02977-5ade-40ce-83a2-373c14023fe7 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.828716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e1166-c6a9-4664-902c-8b1d9ba5ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.830122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1166-c6a9-4664-902c-8b1d9ba5ea12 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.830554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1166-c6a9-4664-902c-8b1d9ba5ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.830977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1166-c6a9-4664-902c-8b1d9ba5ea12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.832052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1166-c6a9-4664-902c-8b1d9ba5ea12 None admin] RBAC: Adding query filter params (role.id=d1262c94c63242cfa4dbc33ff60ac8dd, scope.project.id=07ec6eba37f64872812e5e3802a57be0, user.id=8f667cf8923347dc903c889a5d5b1dcf) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:01.832577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1166-c6a9-4664-902c-8b1d9ba5ea12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.834245 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1166-c6a9-4664-902c-8b1d9ba5ea12 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.842077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 108/208] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:01 2022] GET /identity/v3/role_assignments?user.id=8f667cf8923347dc903c889a5d5b1dcf&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=d1262c94c63242cfa4dbc33ff60ac8dd => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:02.585277 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247292a-4b7a-4ff3-ad1a-147bb0b0bc3a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.585796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247292a-4b7a-4ff3-ad1a-147bb0b0bc3a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.585872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247292a-4b7a-4ff3-ad1a-147bb0b0bc3a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.587916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 101/209] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:02.593696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9182b5-b993-410d-9236-d4d928055990 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.594223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9182b5-b993-410d-9236-d4d928055990 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.594720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9182b5-b993-410d-9236-d4d928055990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.611982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-9c9182b5-b993-410d-9236-d4d928055990 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:02.613526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9c9182b5-b993-410d-9236-d4d928055990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:02.681964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 109/210] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:02.705246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247292a-4b7a-4ff3-ad1a-147bb0b0bc3a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:02.771508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a481f-d8c9-4204-9a32-b303954a38f0 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.771788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a481f-d8c9-4204-9a32-b303954a38f0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.772496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a481f-d8c9-4204-9a32-b303954a38f0 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.774009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 110/211] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:26:02.779843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1249d-0cec-43f5-a72b-c7695822d814 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.780462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1249d-0cec-43f5-a72b-c7695822d814 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.780819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1249d-0cec-43f5-a72b-c7695822d814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.788945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:02.799004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-cce1249d-0cec-43f5-a72b-c7695822d814 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:02.800553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-cce1249d-0cec-43f5-a72b-c7695822d814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:02.826901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247292a-4b7a-4ff3-ad1a-147bb0b0bc3a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:02.874748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b89c6-8dfb-4e84-aa4e-419ae5e76f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:02.876232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b89c6-8dfb-4e84-aa4e-419ae5e76f5f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.876829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b89c6-8dfb-4e84-aa4e-419ae5e76f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.877357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b89c6-8dfb-4e84-aa4e-419ae5e76f5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.888239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 111/212] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:02.891342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b89c6-8dfb-4e84-aa4e-419ae5e76f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-2d4b89c6-8dfb-4e84-aa4e-419ae5e76f5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:02.900213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:02.901112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:02.901896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:02.904558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 102/213] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:02.913384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1249d-0cec-43f5-a72b-c7695822d814 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:02.916676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b89c6-8dfb-4e84-aa4e-419ae5e76f5f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:02.928631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:03.036934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b89c6-8dfb-4e84-aa4e-419ae5e76f5f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:03.046924 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1249d-0cec-43f5-a72b-c7695822d814 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:03.081244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6ce16-dc52-4d39-883a-8feb7878e8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:03.082455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6ce16-dc52-4d39-883a-8feb7878e8ad None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:03.082750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6ce16-dc52-4d39-883a-8feb7878e8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:03.083034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6ce16-dc52-4d39-883a-8feb7878e8ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:03.084458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6ce16-dc52-4d39-883a-8feb7878e8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:03.085917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6ce16-dc52-4d39-883a-8feb7878e8ad None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:03.088681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bde0a-6c5c-4d61-8d2f-221f509f2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:03.089023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 103/214] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:03.089856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bde0a-6c5c-4d61-8d2f-221f509f2a54 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:03.090216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bde0a-6c5c-4d61-8d2f-221f509f2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:03.090565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bde0a-6c5c-4d61-8d2f-221f509f2a54 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:03.091383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bde0a-6c5c-4d61-8d2f-221f509f2a54 None admin] RBAC: Adding query filter params (name=member) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:03.091755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bde0a-6c5c-4d61-8d2f-221f509f2a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:03.093546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bde0a-6c5c-4d61-8d2f-221f509f2a54 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:03.097165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6ce16-dc52-4d39-883a-8feb7878e8ad None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:03.104094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:03.110588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 112/215] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:03.111564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bde0a-6c5c-4d61-8d2f-221f509f2a54 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:03.196883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:03.233671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bde0a-6c5c-4d61-8d2f-221f509f2a54 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:03.247035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6ce16-dc52-4d39-883a-8feb7878e8ad None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:03.270683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06da861-8970-4561-bad0-0ee2987070a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:03.271836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06da861-8970-4561-bad0-0ee2987070a1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:03.272323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06da861-8970-4561-bad0-0ee2987070a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:03.272777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06da861-8970-4561-bad0-0ee2987070a1 None admin] PATH_INFO: `/v3/users/0869e17e7f6147f58f402ca708bd60f5` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:03.288269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06da861-8970-4561-bad0-0ee2987070a1 None admin] RBAC: Authorizing `identity:get_user(user_id=0869e17e7f6147f58f402ca708bd60f5)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:03.290702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06da861-8970-4561-bad0-0ee2987070a1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:03.297095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14672c-7eb0-4b90-8f69-be060d40fd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:03.297095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14672c-7eb0-4b90-8f69-be060d40fd6b None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:03.297095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14672c-7eb0-4b90-8f69-be060d40fd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:03.297095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14672c-7eb0-4b90-8f69-be060d40fd6b None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:03.297448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14672c-7eb0-4b90-8f69-be060d40fd6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:03.297448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14672c-7eb0-4b90-8f69-be060d40fd6b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:03.298142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 113/216] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:03 2022] GET /identity/v3/users/0869e17e7f6147f58f402ca708bd60f5 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:03.299187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06da861-8970-4561-bad0-0ee2987070a1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:03.404339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 104/217] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:26:03 2022] POST /identity/v3/users => generated 297 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:03.418108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06da861-8970-4561-bad0-0ee2987070a1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:03.454205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:03.460501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192365a8-430c-499b-8712-06447b29f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:03.461171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192365a8-430c-499b-8712-06447b29f507 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:03.461545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192365a8-430c-499b-8712-06447b29f507 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:03.462717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192365a8-430c-499b-8712-06447b29f507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:03.542045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192365a8-430c-499b-8712-06447b29f507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:03.543899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192365a8-430c-499b-8712-06447b29f507 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:03.656479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 114/218] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:03.663125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14672c-7eb0-4b90-8f69-be060d40fd6b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:03.731520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:03.778943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14672c-7eb0-4b90-8f69-be060d40fd6b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:03.823598 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b033b7-a9a8-45d3-84aa-c19e119a8b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:03.824795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b033b7-a9a8-45d3-84aa-c19e119a8b47 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:03.825257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b033b7-a9a8-45d3-84aa-c19e119a8b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:03.825732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b033b7-a9a8-45d3-84aa-c19e119a8b47 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:03.827875 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b033b7-a9a8-45d3-84aa-c19e119a8b47 None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:03.829562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b033b7-a9a8-45d3-84aa-c19e119a8b47 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:03.831774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 105/219] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:03 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:03.838111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192365a8-430c-499b-8712-06447b29f507 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:03.871737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:03.961109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192365a8-430c-499b-8712-06447b29f507 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:03.985453 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebcf09-a604-400b-b31f-6a133e7dfd8c None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:03.985685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebcf09-a604-400b-b31f-6a133e7dfd8c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:03.985964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebcf09-a604-400b-b31f-6a133e7dfd8c None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:03.987434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 106/220] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:26:03.992557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4601f-8fa2-4cad-8fe8-61840658ce6f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:03.992904 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4601f-8fa2-4cad-8fe8-61840658ce6f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:03.993199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4601f-8fa2-4cad-8fe8-61840658ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.012380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6ee4601f-8fa2-4cad-8fe8-61840658ce6f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:04.013596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6ee4601f-8fa2-4cad-8fe8-61840658ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:04.015476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7fe2-a384-474f-b062-0a7e97436af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:04.016509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7fe2-a384-474f-b062-0a7e97436af1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.017815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7fe2-a384-474f-b062-0a7e97436af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.018275 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7fe2-a384-474f-b062-0a7e97436af1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.019309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7fe2-a384-474f-b062-0a7e97436af1 None admin] RBAC: Adding query filter params (role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=edc11b80eb824c8391530bc7bb78d27c, user.id=0869e17e7f6147f58f402ca708bd60f5) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:04.020053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7fe2-a384-474f-b062-0a7e97436af1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:04.021704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7fe2-a384-474f-b062-0a7e97436af1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:04.034393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 115/221] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:03 2022] GET /identity/v3/role_assignments?user.id=0869e17e7f6147f58f402ca708bd60f5&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:04.112009 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 107/222] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:04.151196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7fe2-a384-474f-b062-0a7e97436af1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:04.283907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:04.293254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7fe2-a384-474f-b062-0a7e97436af1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:04.346595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a258e1-ebb0-4b95-89a0-4cb6639def95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:04.347410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a258e1-ebb0-4b95-89a0-4cb6639def95 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.347695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a258e1-ebb0-4b95-89a0-4cb6639def95 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.347968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a258e1-ebb0-4b95-89a0-4cb6639def95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.356190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715698d1-0283-4be1-b6d9-4daec1b239e4 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.356528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715698d1-0283-4be1-b6d9-4daec1b239e4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.356848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715698d1-0283-4be1-b6d9-4daec1b239e4 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.358292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 108/223] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:26:04.363741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58ac5f-c6b0-48dd-8ec3-5c650733e7eb None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.364032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58ac5f-c6b0-48dd-8ec3-5c650733e7eb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.364315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58ac5f-c6b0-48dd-8ec3-5c650733e7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.371297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a258e1-ebb0-4b95-89a0-4cb6639def95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-49a258e1-ebb0-4b95-89a0-4cb6639def95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:04.390209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:04.391174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:04.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:04.397825 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 116/224] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:26:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:04.403295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-5e58ac5f-c6b0-48dd-8ec3-5c650733e7eb None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:04.404634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5e58ac5f-c6b0-48dd-8ec3-5c650733e7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:04.407505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a258e1-ebb0-4b95-89a0-4cb6639def95 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:04.501395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:04.536175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 109/225] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 23 16:26:04.580909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a258e1-ebb0-4b95-89a0-4cb6639def95 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:04.585116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58ac5f-c6b0-48dd-8ec3-5c650733e7eb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:04.642744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d98b9e-de05-4e7b-9d34-5f0d6321af6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:04.643425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d98b9e-de05-4e7b-9d34-5f0d6321af6a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.643714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d98b9e-de05-4e7b-9d34-5f0d6321af6a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.643993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d98b9e-de05-4e7b-9d34-5f0d6321af6a None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.645040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d98b9e-de05-4e7b-9d34-5f0d6321af6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:04.645350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d98b9e-de05-4e7b-9d34-5f0d6321af6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:04.646764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d98b9e-de05-4e7b-9d34-5f0d6321af6a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:04.662704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 117/226] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:04.668032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d98b9e-de05-4e7b-9d34-5f0d6321af6a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:04.703566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:04.735455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58ac5f-c6b0-48dd-8ec3-5c650733e7eb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:04.795579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201675d-4a0b-47c0-8336-121f98fb13ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:04.796350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201675d-4a0b-47c0-8336-121f98fb13ea None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.796620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201675d-4a0b-47c0-8336-121f98fb13ea None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.796985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201675d-4a0b-47c0-8336-121f98fb13ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.808280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201675d-4a0b-47c0-8336-121f98fb13ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-c201675d-4a0b-47c0-8336-121f98fb13ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:04.818694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:04.819562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:04.820412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 110/227] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:26:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:04.831118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201675d-4a0b-47c0-8336-121f98fb13ea None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:04.849236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d98b9e-de05-4e7b-9d34-5f0d6321af6a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:04.914765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59257704-39b1-4517-b2a8-7046e44024e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:04.915680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59257704-39b1-4517-b2a8-7046e44024e2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.915958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59257704-39b1-4517-b2a8-7046e44024e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.916236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59257704-39b1-4517-b2a8-7046e44024e2 None admin] PATH_INFO: `/v3/users/f5991174fbc84416afae1daafbafac86` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.917304 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:04.918899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59257704-39b1-4517-b2a8-7046e44024e2 None admin] RBAC: Authorizing `identity:get_user(user_id=f5991174fbc84416afae1daafbafac86)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:04.920417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59257704-39b1-4517-b2a8-7046e44024e2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:04.924752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 118/228] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:04 2022] GET /identity/v3/users/f5991174fbc84416afae1daafbafac86 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:04.930290 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59257704-39b1-4517-b2a8-7046e44024e2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:05.007799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201675d-4a0b-47c0-8336-121f98fb13ea None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:05.076738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b7535-c7c2-46ab-92d0-9c5c9dd8dc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:05.077341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b7535-c7c2-46ab-92d0-9c5c9dd8dc69 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:05.077627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b7535-c7c2-46ab-92d0-9c5c9dd8dc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:05.077906 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b7535-c7c2-46ab-92d0-9c5c9dd8dc69 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:05.078673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b7535-c7c2-46ab-92d0-9c5c9dd8dc69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:05.078982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b7535-c7c2-46ab-92d0-9c5c9dd8dc69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:05.080426 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b7535-c7c2-46ab-92d0-9c5c9dd8dc69 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:05.094428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:05.103623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 111/229] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:05.120924 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59257704-39b1-4517-b2a8-7046e44024e2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:05.122652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b7535-c7c2-46ab-92d0-9c5c9dd8dc69 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:05.184087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53543c0c-5ec4-4934-a8c8-55cbeef39516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:05.185029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53543c0c-5ec4-4934-a8c8-55cbeef39516 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:05.185368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53543c0c-5ec4-4934-a8c8-55cbeef39516 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:05.185654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53543c0c-5ec4-4934-a8c8-55cbeef39516 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:05.188342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53543c0c-5ec4-4934-a8c8-55cbeef39516 None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:05.188503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53543c0c-5ec4-4934-a8c8-55cbeef39516 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:05.190429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 119/230] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:04 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:05.195944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53543c0c-5ec4-4934-a8c8-55cbeef39516 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:05.307713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b7535-c7c2-46ab-92d0-9c5c9dd8dc69 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:05.323099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:05.376198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b019-e306-4040-8286-78f7cad2efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:05.377034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b019-e306-4040-8286-78f7cad2efb0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:05.377318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b019-e306-4040-8286-78f7cad2efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:05.377593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b019-e306-4040-8286-78f7cad2efb0 None admin] PATH_INFO: `/v3/users/f5991174fbc84416afae1daafbafac86` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:05.378995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b019-e306-4040-8286-78f7cad2efb0 None admin] RBAC: Authorizing `identity:get_user(user_id=f5991174fbc84416afae1daafbafac86)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:05.380493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b019-e306-4040-8286-78f7cad2efb0 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:05.382145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 112/231] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:05 2022] GET /identity/v3/users/f5991174fbc84416afae1daafbafac86 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:05.388314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53543c0c-5ec4-4934-a8c8-55cbeef39516 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:05.390490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b019-e306-4040-8286-78f7cad2efb0 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:05.469011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696398a-2bd1-4123-ae4d-bca54662903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:05.469922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696398a-2bd1-4123-ae4d-bca54662903f None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:05.470208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696398a-2bd1-4123-ae4d-bca54662903f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:05.470486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696398a-2bd1-4123-ae4d-bca54662903f None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c/users/f5991174fbc84416afae1daafbafac86/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:05.474280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696398a-2bd1-4123-ae4d-bca54662903f None admin] RBAC: Authorizing `identity:create_grant(project_id=edc11b80eb824c8391530bc7bb78d27c, user_id=f5991174fbc84416afae1daafbafac86, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:05.475752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696398a-2bd1-4123-ae4d-bca54662903f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:05.520955 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b019-e306-4040-8286-78f7cad2efb0 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:05.560400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8d0b4-df46-4503-a042-5bf0acdbfb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:05.561419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8d0b4-df46-4503-a042-5bf0acdbfb9a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:05.561710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8d0b4-df46-4503-a042-5bf0acdbfb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:05.561989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8d0b4-df46-4503-a042-5bf0acdbfb9a None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:05.563196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 120/232] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:26:05 2022] PUT /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c/users/f5991174fbc84416afae1daafbafac86/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:05.563565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8d0b4-df46-4503-a042-5bf0acdbfb9a None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:05.565073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8d0b4-df46-4503-a042-5bf0acdbfb9a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:05.573249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 113/233] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:05 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:05.579451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696398a-2bd1-4123-ae4d-bca54662903f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:05.604324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:05.729596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696398a-2bd1-4123-ae4d-bca54662903f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:05.784854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e561c7-f142-4d84-853d-9817269b5bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:05.786142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e561c7-f142-4d84-853d-9817269b5bdd None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:05.786638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e561c7-f142-4d84-853d-9817269b5bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:05.787111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e561c7-f142-4d84-853d-9817269b5bdd None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c/users/f5991174fbc84416afae1daafbafac86/roles/c07ef3c8c1574bb987c394026b04fb39` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:05.793106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e561c7-f142-4d84-853d-9817269b5bdd None admin] RBAC: Authorizing `identity:create_grant(project_id=edc11b80eb824c8391530bc7bb78d27c, user_id=f5991174fbc84416afae1daafbafac86, role_id=c07ef3c8c1574bb987c394026b04fb39)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:05.794862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e561c7-f142-4d84-853d-9817269b5bdd None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:05.877586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 121/234] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:26:05 2022] PUT /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c/users/f5991174fbc84416afae1daafbafac86/roles/c07ef3c8c1574bb987c394026b04fb39 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:06.156531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38ec07-767d-4131-8400-44618088fdac None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.157032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38ec07-767d-4131-8400-44618088fdac None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.157106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38ec07-767d-4131-8400-44618088fdac None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.158470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 114/235] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:06.164140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356b04-7409-4b67-9687-3ef293ad44fd None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.165662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356b04-7409-4b67-9687-3ef293ad44fd None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.166143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356b04-7409-4b67-9687-3ef293ad44fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.187939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b2356b04-7409-4b67-9687-3ef293ad44fd None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:06.189525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b2356b04-7409-4b67-9687-3ef293ad44fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:06.296190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 122/236] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:06.314293 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bfe1d-a8a9-4ee2-ba32-22abac56e380 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.314648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bfe1d-a8a9-4ee2-ba32-22abac56e380 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.314936 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bfe1d-a8a9-4ee2-ba32-22abac56e380 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.316533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 115/237] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:06.322778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da0bd8-0744-458c-a6a6-ab75ed96c724 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.323076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da0bd8-0744-458c-a6a6-ab75ed96c724 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.323359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da0bd8-0744-458c-a6a6-ab75ed96c724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.329742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bfe1d-a8a9-4ee2-ba32-22abac56e380 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.332163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:06.349300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-87da0bd8-0744-458c-a6a6-ab75ed96c724 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:06.354188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-87da0bd8-0744-458c-a6a6-ab75ed96c724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:06.381579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:06.469367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 123/238] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:06.481001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bfe1d-a8a9-4ee2-ba32-22abac56e380 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.496225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da0bd8-0744-458c-a6a6-ab75ed96c724 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.548923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b89d3-fe57-4e6e-9cbd-c0ba922b4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.549727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b89d3-fe57-4e6e-9cbd-c0ba922b4b77 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.550009 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b89d3-fe57-4e6e-9cbd-c0ba922b4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.550286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b89d3-fe57-4e6e-9cbd-c0ba922b4b77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.551626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b89d3-fe57-4e6e-9cbd-c0ba922b4b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:06.553113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b89d3-fe57-4e6e-9cbd-c0ba922b4b77 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:06.554744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 116/239] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:06.564400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b89d3-fe57-4e6e-9cbd-c0ba922b4b77 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.687964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da0bd8-0744-458c-a6a6-ab75ed96c724 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.700130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b89d3-fe57-4e6e-9cbd-c0ba922b4b77 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.714974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:06.743342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369553c3-d78f-42b4-a8df-bcd30b10eee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.744696 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369553c3-d78f-42b4-a8df-bcd30b10eee7 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.744984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369553c3-d78f-42b4-a8df-bcd30b10eee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.745264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369553c3-d78f-42b4-a8df-bcd30b10eee7 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.745998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369553c3-d78f-42b4-a8df-bcd30b10eee7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:06.747462 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369553c3-d78f-42b4-a8df-bcd30b10eee7 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:06.768480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443101e-5747-4a5a-ae43-d8c769259960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.769581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443101e-5747-4a5a-ae43-d8c769259960 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.769874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443101e-5747-4a5a-ae43-d8c769259960 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.770196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443101e-5747-4a5a-ae43-d8c769259960 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.771209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:06.782877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443101e-5747-4a5a-ae43-d8c769259960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-2443101e-5747-4a5a-ae43-d8c769259960 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:06.792179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:06.794618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:06.795404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 124/240] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:06.799460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443101e-5747-4a5a-ae43-d8c769259960 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.878834 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 117/241] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:06.880549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ff753-3f6a-4891-93cf-ef04a72d1804 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.880847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ff753-3f6a-4891-93cf-ef04a72d1804 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.881128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ff753-3f6a-4891-93cf-ef04a72d1804 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.882803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 118/242] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:06.889626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da9cd6-f5d5-4387-9c2f-f2a7e8884964 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.889921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da9cd6-f5d5-4387-9c2f-f2a7e8884964 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.890211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da9cd6-f5d5-4387-9c2f-f2a7e8884964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.910388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-25da9cd6-f5d5-4387-9c2f-f2a7e8884964 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:06.911719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-25da9cd6-f5d5-4387-9c2f-f2a7e8884964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:06.931964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443101e-5747-4a5a-ae43-d8c769259960 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.990439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 119/243] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:06.996610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178eb51-22e3-4206-b959-e871de65c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.997227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178eb51-22e3-4206-b959-e871de65c48f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.997509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178eb51-22e3-4206-b959-e871de65c48f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.997784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178eb51-22e3-4206-b959-e871de65c48f None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.998551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178eb51-22e3-4206-b959-e871de65c48f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:06.998853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178eb51-22e3-4206-b959-e871de65c48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.000363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178eb51-22e3-4206-b959-e871de65c48f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.014207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 125/244] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:07.020372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da9cd6-f5d5-4387-9c2f-f2a7e8884964 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.053237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178eb51-22e3-4206-b959-e871de65c48f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.167591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:07.173307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:07.177099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da9cd6-f5d5-4387-9c2f-f2a7e8884964 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.215324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17f0e-f816-4466-a0b2-1ea529a3a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.215324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17f0e-f816-4466-a0b2-1ea529a3a914 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.215324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17f0e-f816-4466-a0b2-1ea529a3a914 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.215324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17f0e-f816-4466-a0b2-1ea529a3a914 None admin] PATH_INFO: `/v3/users/130d8cd7110e42a7b4439a9ede6adb10` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.216785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178eb51-22e3-4206-b959-e871de65c48f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.231262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc17f0e-f816-4466-a0b2-1ea529a3a914 None admin] RBAC: Authorizing `identity:get_user(user_id=130d8cd7110e42a7b4439a9ede6adb10)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.232788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc17f0e-f816-4466-a0b2-1ea529a3a914 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.234545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 120/245] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/users/130d8cd7110e42a7b4439a9ede6adb10 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:07.241657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17f0e-f816-4466-a0b2-1ea529a3a914 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.258049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c7f49-4848-41a4-a96a-07b63921ed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.259307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c7f49-4848-41a4-a96a-07b63921ed62 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.259591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c7f49-4848-41a4-a96a-07b63921ed62 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.259867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c7f49-4848-41a4-a96a-07b63921ed62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.271136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c7f49-4848-41a4-a96a-07b63921ed62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-0b6c7f49-4848-41a4-a96a-07b63921ed62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:07.280603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:07.281515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:07.282917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 126/246] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:07.287833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c7f49-4848-41a4-a96a-07b63921ed62 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.354913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17f0e-f816-4466-a0b2-1ea529a3a914 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.390585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba5038-47b6-47b2-894f-76241d9add35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.391240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba5038-47b6-47b2-894f-76241d9add35 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.391521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba5038-47b6-47b2-894f-76241d9add35 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.391795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba5038-47b6-47b2-894f-76241d9add35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.405637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c7f49-4848-41a4-a96a-07b63921ed62 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.419941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:07.444980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd91226-58e4-4db1-9708-4bebe48ab5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.445659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91226-58e4-4db1-9708-4bebe48ab5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.446064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91226-58e4-4db1-9708-4bebe48ab5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.446562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91226-58e4-4db1-9708-4bebe48ab5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.447335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd91226-58e4-4db1-9708-4bebe48ab5c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:07.447642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd91226-58e4-4db1-9708-4bebe48ab5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.449588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd91226-58e4-4db1-9708-4bebe48ab5c6 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.452252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:07.459712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 127/247] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:07.466030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd91226-58e4-4db1-9708-4bebe48ab5c6 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.469196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba5038-47b6-47b2-894f-76241d9add35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.471023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba5038-47b6-47b2-894f-76241d9add35 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.582051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd91226-58e4-4db1-9708-4bebe48ab5c6 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.602999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 121/248] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:07.608646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba5038-47b6-47b2-894f-76241d9add35 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.628316 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71f6cd-b935-4908-94bc-aafbe428fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.629314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71f6cd-b935-4908-94bc-aafbe428fb03 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.629605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71f6cd-b935-4908-94bc-aafbe428fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.629887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71f6cd-b935-4908-94bc-aafbe428fb03 None admin] PATH_INFO: `/v3/users/0869e17e7f6147f58f402ca708bd60f5` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.631167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71f6cd-b935-4908-94bc-aafbe428fb03 None admin] RBAC: Authorizing `identity:get_user(user_id=0869e17e7f6147f58f402ca708bd60f5)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.633304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71f6cd-b935-4908-94bc-aafbe428fb03 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.634483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 128/249] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/users/0869e17e7f6147f58f402ca708bd60f5 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:07.640054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71f6cd-b935-4908-94bc-aafbe428fb03 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.683608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:07.695282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:07.733868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba5038-47b6-47b2-894f-76241d9add35 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.766749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71f6cd-b935-4908-94bc-aafbe428fb03 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.774774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90f15-e1c4-4127-9cfc-089e70e7b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.775741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90f15-e1c4-4127-9cfc-089e70e7b54f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.776023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90f15-e1c4-4127-9cfc-089e70e7b54f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.776315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90f15-e1c4-4127-9cfc-089e70e7b54f None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.778385 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90f15-e1c4-4127-9cfc-089e70e7b54f None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.778983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90f15-e1c4-4127-9cfc-089e70e7b54f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.781206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 122/250] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:07.787402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90f15-e1c4-4127-9cfc-089e70e7b54f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.862540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e6409-ad63-4652-bc7d-60ce34f5805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.863778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e6409-ad63-4652-bc7d-60ce34f5805c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.864266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e6409-ad63-4652-bc7d-60ce34f5805c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.864770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e6409-ad63-4652-bc7d-60ce34f5805c None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.869050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e6409-ad63-4652-bc7d-60ce34f5805c None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.870893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e6409-ad63-4652-bc7d-60ce34f5805c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.872916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 129/251] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:07.883048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e6409-ad63-4652-bc7d-60ce34f5805c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:08.034623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90f15-e1c4-4127-9cfc-089e70e7b54f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:08.073872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:08.089093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc437204-5fc0-4842-8fa6-6c3cc4269e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:08.090090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437204-5fc0-4842-8fa6-6c3cc4269e7a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:08.090090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437204-5fc0-4842-8fa6-6c3cc4269e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:08.090329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437204-5fc0-4842-8fa6-6c3cc4269e7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:08.091180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437204-5fc0-4842-8fa6-6c3cc4269e7a None admin] RBAC: Adding query filter params (role.id=d1262c94c63242cfa4dbc33ff60ac8dd, scope.project.id=edc11b80eb824c8391530bc7bb78d27c, user.id=130d8cd7110e42a7b4439a9ede6adb10) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:08.091501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437204-5fc0-4842-8fa6-6c3cc4269e7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:08.093017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437204-5fc0-4842-8fa6-6c3cc4269e7a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:08.099507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e6409-ad63-4652-bc7d-60ce34f5805c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:08.104766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 123/252] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/role_assignments?user.id=130d8cd7110e42a7b4439a9ede6adb10&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=d1262c94c63242cfa4dbc33ff60ac8dd => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:08.134304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:08.173091 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6adc2-3446-4b85-a137-f3c5607fb5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:08.174012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6adc2-3446-4b85-a137-f3c5607fb5d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:08.174295 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6adc2-3446-4b85-a137-f3c5607fb5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:08.174571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6adc2-3446-4b85-a137-f3c5607fb5d2 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c/users/0869e17e7f6147f58f402ca708bd60f5/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:08.176690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6adc2-3446-4b85-a137-f3c5607fb5d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=edc11b80eb824c8391530bc7bb78d27c, user_id=0869e17e7f6147f58f402ca708bd60f5, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:08.178159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6adc2-3446-4b85-a137-f3c5607fb5d2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:08.260166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 130/253] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:26:07 2022] PUT /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c/users/0869e17e7f6147f58f402ca708bd60f5/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:08.637377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0cea2-850e-47a8-9032-71f674992049 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:08.637914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0cea2-850e-47a8-9032-71f674992049 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:08.638184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0cea2-850e-47a8-9032-71f674992049 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:08.639554 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 124/254] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:08.645135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01be6-abba-40ae-83ea-bc9b3feccdc4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:08.645423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01be6-abba-40ae-83ea-bc9b3feccdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:08.645699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01be6-abba-40ae-83ea-bc9b3feccdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:08.669366 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-01a01be6-abba-40ae-83ea-bc9b3feccdc4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:08.670577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-01a01be6-abba-40ae-83ea-bc9b3feccdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:08.767476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 131/255] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:08.806794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0cea2-850e-47a8-9032-71f674992049 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:08.929186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0cea2-850e-47a8-9032-71f674992049 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:08.966343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de8d0-62a5-440a-955e-16bda9500ef0 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:08.966654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de8d0-62a5-440a-955e-16bda9500ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:08.966903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de8d0-62a5-440a-955e-16bda9500ef0 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:08.968556 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 132/256] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:26:08.973427 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d62b03-ee19-4267-91f0-baf2d2fe99fd None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:08.973712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d62b03-ee19-4267-91f0-baf2d2fe99fd None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:08.973815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9927aa2-51c5-4112-a42a-2333edd90fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:08.974057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d62b03-ee19-4267-91f0-baf2d2fe99fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:08.974775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9927aa2-51c5-4112-a42a-2333edd90fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:08.975062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9927aa2-51c5-4112-a42a-2333edd90fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:08.975327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9927aa2-51c5-4112-a42a-2333edd90fc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:08.991848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a1d62b03-ee19-4267-91f0-baf2d2fe99fd None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:08.993661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a1d62b03-ee19-4267-91f0-baf2d2fe99fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:08.997166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9927aa2-51c5-4112-a42a-2333edd90fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-c9927aa2-51c5-4112-a42a-2333edd90fc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:09.006693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:09.007659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:09.009250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 125/257] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:09.013211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9927aa2-51c5-4112-a42a-2333edd90fc0 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:09.140697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:09.155344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 133/258] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:09.193358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d62b03-ee19-4267-91f0-baf2d2fe99fd None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:09.249117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9927aa2-51c5-4112-a42a-2333edd90fc0 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:09.256644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:09.312071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851c4f5-38fe-4b58-abce-0056db53ae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:09.312792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851c4f5-38fe-4b58-abce-0056db53ae48 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:09.313083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851c4f5-38fe-4b58-abce-0056db53ae48 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:09.313368 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851c4f5-38fe-4b58-abce-0056db53ae48 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:09.314125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851c4f5-38fe-4b58-abce-0056db53ae48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:09.314439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851c4f5-38fe-4b58-abce-0056db53ae48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:09.321890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851c4f5-38fe-4b58-abce-0056db53ae48 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:09.335891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 126/259] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:09.340995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851c4f5-38fe-4b58-abce-0056db53ae48 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:09.387152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d62b03-ee19-4267-91f0-baf2d2fe99fd None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:09.429091 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88143d65-4c0a-40e9-91f8-1cc2732f6626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:09.429401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88143d65-4c0a-40e9-91f8-1cc2732f6626 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:09.429693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88143d65-4c0a-40e9-91f8-1cc2732f6626 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:09.430012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88143d65-4c0a-40e9-91f8-1cc2732f6626 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:09.441035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88143d65-4c0a-40e9-91f8-1cc2732f6626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-88143d65-4c0a-40e9-91f8-1cc2732f6626 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:09.449854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:09.450727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:09.451519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 134/260] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:26:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:09.456659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88143d65-4c0a-40e9-91f8-1cc2732f6626 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:09.521374 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851c4f5-38fe-4b58-abce-0056db53ae48 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:09.535474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:09.568762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88143d65-4c0a-40e9-91f8-1cc2732f6626 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:09.572630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:09.576991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418a172-766c-4cd9-9c0a-aad652a41e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:09.578026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418a172-766c-4cd9-9c0a-aad652a41e2d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:09.578420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418a172-766c-4cd9-9c0a-aad652a41e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:09.578802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418a172-766c-4cd9-9c0a-aad652a41e2d None admin] PATH_INFO: `/v3/users/f5991174fbc84416afae1daafbafac86` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:09.580159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418a172-766c-4cd9-9c0a-aad652a41e2d None admin] RBAC: Authorizing `identity:get_user(user_id=f5991174fbc84416afae1daafbafac86)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:09.581747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418a172-766c-4cd9-9c0a-aad652a41e2d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:09.583818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 127/261] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:09 2022] GET /identity/v3/users/f5991174fbc84416afae1daafbafac86 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:09.589017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418a172-766c-4cd9-9c0a-aad652a41e2d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:09.605116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ea76a-af6f-4d20-9828-3a1c3e0a72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:09.605846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ea76a-af6f-4d20-9828-3a1c3e0a72fb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:09.606185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ea76a-af6f-4d20-9828-3a1c3e0a72fb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:09.606459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ea76a-af6f-4d20-9828-3a1c3e0a72fb None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:09.607300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ea76a-af6f-4d20-9828-3a1c3e0a72fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:09.607607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ea76a-af6f-4d20-9828-3a1c3e0a72fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:09.609112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ea76a-af6f-4d20-9828-3a1c3e0a72fb None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:09.624638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 135/262] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:09.626405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ea76a-af6f-4d20-9828-3a1c3e0a72fb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:09.795598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ea76a-af6f-4d20-9828-3a1c3e0a72fb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:09.823560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418a172-766c-4cd9-9c0a-aad652a41e2d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:09.875355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c80b5-e51c-4055-b481-7caf6cf91304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:09.876243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c80b5-e51c-4055-b481-7caf6cf91304 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:09.876551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c80b5-e51c-4055-b481-7caf6cf91304 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:09.876823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c80b5-e51c-4055-b481-7caf6cf91304 None admin] PATH_INFO: `/v3/users/f5991174fbc84416afae1daafbafac86` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:09.878037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c80b5-e51c-4055-b481-7caf6cf91304 None admin] RBAC: Authorizing `identity:get_user(user_id=f5991174fbc84416afae1daafbafac86)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:09.879493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c80b5-e51c-4055-b481-7caf6cf91304 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:09.881654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 136/263] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:09 2022] GET /identity/v3/users/f5991174fbc84416afae1daafbafac86 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:09.886994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c80b5-e51c-4055-b481-7caf6cf91304 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:09.893010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f4331-e2c7-451b-9ce2-79982e564a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:09.893693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4331-e2c7-451b-9ce2-79982e564a0c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:09.893984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4331-e2c7-451b-9ce2-79982e564a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:09.894522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4331-e2c7-451b-9ce2-79982e564a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:09.931510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:09.985024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f4331-e2c7-451b-9ce2-79982e564a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:09.986518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f4331-e2c7-451b-9ce2-79982e564a0c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:09.989639 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:10.074686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c80b5-e51c-4055-b481-7caf6cf91304 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:10.144645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fe6f3-6656-4aa9-976a-ce29ba09489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:10.145866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fe6f3-6656-4aa9-976a-ce29ba09489d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:10.146353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fe6f3-6656-4aa9-976a-ce29ba09489d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:10.146833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fe6f3-6656-4aa9-976a-ce29ba09489d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:10.167969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 128/264] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:10.174167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f4331-e2c7-451b-9ce2-79982e564a0c None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:10.284961 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:10.302406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fe6f3-6656-4aa9-976a-ce29ba09489d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:10.303897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fe6f3-6656-4aa9-976a-ce29ba09489d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:10.320894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f4331-e2c7-451b-9ce2-79982e564a0c None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:10.360745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:10.389386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69023892-d32f-4364-9c37-38ae917b77e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:10.390255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69023892-d32f-4364-9c37-38ae917b77e4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:10.390539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69023892-d32f-4364-9c37-38ae917b77e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:10.390814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69023892-d32f-4364-9c37-38ae917b77e4 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:10.392192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69023892-d32f-4364-9c37-38ae917b77e4 None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:10.395474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69023892-d32f-4364-9c37-38ae917b77e4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:10.398115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 129/265] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:10 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:10.405379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69023892-d32f-4364-9c37-38ae917b77e4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:10.499704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 137/266] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 16:26:10.521318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fe6f3-6656-4aa9-976a-ce29ba09489d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:10.536556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69023892-d32f-4364-9c37-38ae917b77e4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:10.572581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced4f04-f75b-457f-abdc-bea7051e4284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:10.573248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4f04-f75b-457f-abdc-bea7051e4284 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:10.573533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4f04-f75b-457f-abdc-bea7051e4284 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:10.573871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4f04-f75b-457f-abdc-bea7051e4284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:10.574756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced4f04-f75b-457f-abdc-bea7051e4284 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=edc11b80eb824c8391530bc7bb78d27c, user.id=f5991174fbc84416afae1daafbafac86) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:10.575074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced4f04-f75b-457f-abdc-bea7051e4284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:10.576728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced4f04-f75b-457f-abdc-bea7051e4284 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:10.583196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 130/267] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:10 2022] GET /identity/v3/role_assignments?user.id=f5991174fbc84416afae1daafbafac86&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:10.601496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9227-c5a1-4381-835a-c7f0c365e8f0 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:10.602849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9227-c5a1-4381-835a-c7f0c365e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:10.603199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9227-c5a1-4381-835a-c7f0c365e8f0 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:10.604724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 131/268] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:26:10.611626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e328-7d72-4030-afce-a0fcd83d62bb None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:10.611929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e328-7d72-4030-afce-a0fcd83d62bb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:10.612086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e328-7d72-4030-afce-a0fcd83d62bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:10.645520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-22f1e328-7d72-4030-afce-a0fcd83d62bb None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:10.647103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-22f1e328-7d72-4030-afce-a0fcd83d62bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:10.668324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:10.704383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fe6f3-6656-4aa9-976a-ce29ba09489d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:10.740736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:10.769891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca4929-f8de-4b35-8374-9a70a80c814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:10.771169 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4929-f8de-4b35-8374-9a70a80c814f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:10.771680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4929-f8de-4b35-8374-9a70a80c814f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:10.776758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4929-f8de-4b35-8374-9a70a80c814f None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:10.778480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca4929-f8de-4b35-8374-9a70a80c814f None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:10.780223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca4929-f8de-4b35-8374-9a70a80c814f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:10.782562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 138/269] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:10 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:10.788313 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca4929-f8de-4b35-8374-9a70a80c814f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:10.886817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 132/270] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:10.912355 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e328-7d72-4030-afce-a0fcd83d62bb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:10.986126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca4929-f8de-4b35-8374-9a70a80c814f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:11.028071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8377b4-a21d-4d49-a070-074613619e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:11.029006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8377b4-a21d-4d49-a070-074613619e96 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.029440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8377b4-a21d-4d49-a070-074613619e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.029865 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8377b4-a21d-4d49-a070-074613619e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.030899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8377b4-a21d-4d49-a070-074613619e96 None admin] RBAC: Adding query filter params (role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=edc11b80eb824c8391530bc7bb78d27c, user.id=f5991174fbc84416afae1daafbafac86) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:11.031368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8377b4-a21d-4d49-a070-074613619e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:11.033047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8377b4-a21d-4d49-a070-074613619e96 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:11.041190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 139/271] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:10 2022] GET /identity/v3/role_assignments?user.id=f5991174fbc84416afae1daafbafac86&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:11.043036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7c4f8-e1d3-4b2b-9d35-399c6f3eba64 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.043553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7c4f8-e1d3-4b2b-9d35-399c6f3eba64 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.044018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7c4f8-e1d3-4b2b-9d35-399c6f3eba64 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.045744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 140/272] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:11.050457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e328-7d72-4030-afce-a0fcd83d62bb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:11.052271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb83bc-78ae-4a77-8204-fb02d98eb7c4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.052828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb83bc-78ae-4a77-8204-fb02d98eb7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.053029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb83bc-78ae-4a77-8204-fb02d98eb7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.076827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-37bb83bc-78ae-4a77-8204-fb02d98eb7c4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:11.078199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-37bb83bc-78ae-4a77-8204-fb02d98eb7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:11.101155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b39135-c16f-4153-b5d4-e94d55f0c920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:11.102464 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b39135-c16f-4153-b5d4-e94d55f0c920 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.102981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b39135-c16f-4153-b5d4-e94d55f0c920 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.103401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b39135-c16f-4153-b5d4-e94d55f0c920 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.119771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b39135-c16f-4153-b5d4-e94d55f0c920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:11.125957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-d5b39135-c16f-4153-b5d4-e94d55f0c920 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:11.130695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:11.131785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:11.132833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:11.136248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 133/273] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:11.149432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b39135-c16f-4153-b5d4-e94d55f0c920 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:11.150731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:11.178640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 141/274] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:11.204252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb83bc-78ae-4a77-8204-fb02d98eb7c4 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:11.259790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b39135-c16f-4153-b5d4-e94d55f0c920 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:11.297916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e29a3a-10b5-4452-a6c9-94b26cb743bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:11.298842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e29a3a-10b5-4452-a6c9-94b26cb743bc None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.299287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e29a3a-10b5-4452-a6c9-94b26cb743bc None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.299708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e29a3a-10b5-4452-a6c9-94b26cb743bc None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.300651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e29a3a-10b5-4452-a6c9-94b26cb743bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:11.301178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e29a3a-10b5-4452-a6c9-94b26cb743bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:11.302879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e29a3a-10b5-4452-a6c9-94b26cb743bc None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:11.313571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 134/275] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:11.315238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5c474-77e7-4677-8dc2-f5b3e00ce7bd None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.315715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5c474-77e7-4677-8dc2-f5b3e00ce7bd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.320337 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5c474-77e7-4677-8dc2-f5b3e00ce7bd None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.323074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 135/276] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:11.324758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5c474-77e7-4677-8dc2-f5b3e00ce7bd None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:11.329479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb83bc-78ae-4a77-8204-fb02d98eb7c4 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:11.371735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079416f7-c2de-411f-944e-03509e953cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:11.373135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079416f7-c2de-411f-944e-03509e953cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.373135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079416f7-c2de-411f-944e-03509e953cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.373350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079416f7-c2de-411f-944e-03509e953cb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.374430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079416f7-c2de-411f-944e-03509e953cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:11.376008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079416f7-c2de-411f-944e-03509e953cb0 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:11.379992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 142/277] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:11.381482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d63f4-611d-407e-b4ff-4b1dbf420e20 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.381665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d63f4-611d-407e-b4ff-4b1dbf420e20 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.381944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d63f4-611d-407e-b4ff-4b1dbf420e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.399586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:11.404967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-559d63f4-611d-407e-b4ff-4b1dbf420e20 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:11.406342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-559d63f4-611d-407e-b4ff-4b1dbf420e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:11.456913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5c474-77e7-4677-8dc2-f5b3e00ce7bd None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:11.468228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:11.504471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 143/278] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:11.505906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d63f4-611d-407e-b4ff-4b1dbf420e20 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:11.509091 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bceb6-5055-4682-8420-21b61c004fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:11.510147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bceb6-5055-4682-8420-21b61c004fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.510511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bceb6-5055-4682-8420-21b61c004fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.511740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bceb6-5055-4682-8420-21b61c004fe8 None admin] PATH_INFO: `/v3/users/8698f285b4e34fa1bc938f259ef597c2` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.527481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bceb6-5055-4682-8420-21b61c004fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=8698f285b4e34fa1bc938f259ef597c2)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:11.529033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bceb6-5055-4682-8420-21b61c004fe8 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:11.531194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 136/279] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:11 2022] GET /identity/v3/users/8698f285b4e34fa1bc938f259ef597c2 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:11.532067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bceb6-5055-4682-8420-21b61c004fe8 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:11.618817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d63f4-611d-407e-b4ff-4b1dbf420e20 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:11.641647 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bceb6-5055-4682-8420-21b61c004fe8 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:11.654727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90e15f-989e-4503-9255-cf38565db907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:11.655332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e15f-989e-4503-9255-cf38565db907 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.655615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e15f-989e-4503-9255-cf38565db907 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.655899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e15f-989e-4503-9255-cf38565db907 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.656627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90e15f-989e-4503-9255-cf38565db907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:11.658108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90e15f-989e-4503-9255-cf38565db907 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:11.663711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:11.681513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92a85b-2ebd-42b2-9b80-1b30c4b28c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:11.682351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92a85b-2ebd-42b2-9b80-1b30c4b28c6f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.682708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92a85b-2ebd-42b2-9b80-1b30c4b28c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.682988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92a85b-2ebd-42b2-9b80-1b30c4b28c6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.695181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92a85b-2ebd-42b2-9b80-1b30c4b28c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-bc92a85b-2ebd-42b2-9b80-1b30c4b28c6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:11.703249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:11.704474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 137/280] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:11.705471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92a85b-2ebd-42b2-9b80-1b30c4b28c6f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:11.794385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 144/281] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:26:11 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:11.795684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90e15f-989e-4503-9255-cf38565db907 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:11.811984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92a85b-2ebd-42b2-9b80-1b30c4b28c6f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:11.861293 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:11.869363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dbcc8-a30d-4861-9c18-068f9aeaa78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:11.870318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dbcc8-a30d-4861-9c18-068f9aeaa78d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.871528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dbcc8-a30d-4861-9c18-068f9aeaa78d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.871858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dbcc8-a30d-4861-9c18-068f9aeaa78d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.872753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dbcc8-a30d-4861-9c18-068f9aeaa78d None admin] RBAC: Adding query filter params (role.id=6b4e2fa093c2483a91793d5ad27bc6e8, user.id=8698f285b4e34fa1bc938f259ef597c2, scope.system=all) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:11.873079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dbcc8-a30d-4861-9c18-068f9aeaa78d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:11.874608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dbcc8-a30d-4861-9c18-068f9aeaa78d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:11.884235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 138/282] 10.222.0.74 () {56 vars in 1308 bytes} [Mon May 23 16:26:11 2022] GET /identity/v3/role_assignments?user.id=8698f285b4e34fa1bc938f259ef597c2&scope.system=all&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:11.884235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed372e-7432-4b91-b2f0-ef7f01aff21d None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.884235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed372e-7432-4b91-b2f0-ef7f01aff21d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.884235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed372e-7432-4b91-b2f0-ef7f01aff21d None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.884235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 139/283] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:11.889991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558a902-ea80-43de-b716-663bfc0ce31f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.890922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558a902-ea80-43de-b716-663bfc0ce31f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.890922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558a902-ea80-43de-b716-663bfc0ce31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.909696 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c558a902-ea80-43de-b716-663bfc0ce31f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:11.910962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c558a902-ea80-43de-b716-663bfc0ce31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:11.945059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90e15f-989e-4503-9255-cf38565db907 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:11.971735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:11.987914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7527b-5946-4ea3-90b5-24d81eec7344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:11.988857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7527b-5946-4ea3-90b5-24d81eec7344 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:11.989244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7527b-5946-4ea3-90b5-24d81eec7344 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:11.989625 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7527b-5946-4ea3-90b5-24d81eec7344 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:11.990500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7527b-5946-4ea3-90b5-24d81eec7344 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:11.990911 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7527b-5946-4ea3-90b5-24d81eec7344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:11.993006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7527b-5946-4ea3-90b5-24d81eec7344 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:12.005958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 145/284] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:12.012040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7527b-5946-4ea3-90b5-24d81eec7344 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:12.014986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 140/285] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:12.046666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558a902-ea80-43de-b716-663bfc0ce31f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:12.152604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:12.155205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7527b-5946-4ea3-90b5-24d81eec7344 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:12.193005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558a902-ea80-43de-b716-663bfc0ce31f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:12.206726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48356c-1388-45de-a77d-7fc85bf25780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:12.207976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48356c-1388-45de-a77d-7fc85bf25780 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:12.208495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48356c-1388-45de-a77d-7fc85bf25780 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:12.208969 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48356c-1388-45de-a77d-7fc85bf25780 None admin] PATH_INFO: `/v3/users/130d8cd7110e42a7b4439a9ede6adb10` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:12.210470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48356c-1388-45de-a77d-7fc85bf25780 None admin] RBAC: Authorizing `identity:get_user(user_id=130d8cd7110e42a7b4439a9ede6adb10)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:12.212967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48356c-1388-45de-a77d-7fc85bf25780 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:12.214926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 146/286] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:12 2022] GET /identity/v3/users/130d8cd7110e42a7b4439a9ede6adb10 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:12.221406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48356c-1388-45de-a77d-7fc85bf25780 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:12.243686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea031-ad71-4d66-a033-384e89d282d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:12.244595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea031-ad71-4d66-a033-384e89d282d6 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:12.244878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea031-ad71-4d66-a033-384e89d282d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:12.245151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea031-ad71-4d66-a033-384e89d282d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:12.265544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aea031-ad71-4d66-a033-384e89d282d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-52aea031-ad71-4d66-a033-384e89d282d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:12.277285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:12.278199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:12.278996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 141/287] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:12.286773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea031-ad71-4d66-a033-384e89d282d6 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:12.335101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:12.346384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48356c-1388-45de-a77d-7fc85bf25780 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:12.404040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa97593-6e53-412e-a17c-9374251004ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:12.404939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa97593-6e53-412e-a17c-9374251004ed None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:12.405221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa97593-6e53-412e-a17c-9374251004ed None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:12.405495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa97593-6e53-412e-a17c-9374251004ed None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:12.407432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa97593-6e53-412e-a17c-9374251004ed None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:12.408907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa97593-6e53-412e-a17c-9374251004ed None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:12.411883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 147/288] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:12 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:12.425220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa97593-6e53-412e-a17c-9374251004ed None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:12.451347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea031-ad71-4d66-a033-384e89d282d6 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:12.489384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:12.509211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc4baf-ec10-4d23-95f6-1f328f9b5a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:12.510166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc4baf-ec10-4d23-95f6-1f328f9b5a08 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:12.510589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc4baf-ec10-4d23-95f6-1f328f9b5a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:12.511003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc4baf-ec10-4d23-95f6-1f328f9b5a08 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:12.511894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc4baf-ec10-4d23-95f6-1f328f9b5a08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:12.512361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc4baf-ec10-4d23-95f6-1f328f9b5a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:12.514263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc4baf-ec10-4d23-95f6-1f328f9b5a08 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:12.524439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 142/289] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:12.530427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc4baf-ec10-4d23-95f6-1f328f9b5a08 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:12.604076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa97593-6e53-412e-a17c-9374251004ed None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:12.640027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721a56-2d45-4329-8735-274540e14d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:12.641328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721a56-2d45-4329-8735-274540e14d4e None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:12.641812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721a56-2d45-4329-8735-274540e14d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:12.642305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721a56-2d45-4329-8735-274540e14d4e None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c/users/130d8cd7110e42a7b4439a9ede6adb10/roles/d1262c94c63242cfa4dbc33ff60ac8dd` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:12.644779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721a56-2d45-4329-8735-274540e14d4e None admin] RBAC: Authorizing `identity:create_grant(project_id=edc11b80eb824c8391530bc7bb78d27c, user_id=130d8cd7110e42a7b4439a9ede6adb10, role_id=d1262c94c63242cfa4dbc33ff60ac8dd)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:12.646437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721a56-2d45-4329-8735-274540e14d4e None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:12.694665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 148/290] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:26:12 2022] PUT /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c/users/130d8cd7110e42a7b4439a9ede6adb10/roles/d1262c94c63242cfa4dbc33ff60ac8dd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:26:12.698928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:12.705207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc4baf-ec10-4d23-95f6-1f328f9b5a08 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:12.759300 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d624f-1d93-491f-a001-863204ffb444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:12.760075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d624f-1d93-491f-a001-863204ffb444 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:12.760384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d624f-1d93-491f-a001-863204ffb444 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:12.760662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d624f-1d93-491f-a001-863204ffb444 None admin] PATH_INFO: `/v3/users/0869e17e7f6147f58f402ca708bd60f5` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:12.763317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d624f-1d93-491f-a001-863204ffb444 None admin] RBAC: Authorizing `identity:get_user(user_id=0869e17e7f6147f58f402ca708bd60f5)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:12.764858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d624f-1d93-491f-a001-863204ffb444 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:12.766987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 143/291] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:12 2022] GET /identity/v3/users/0869e17e7f6147f58f402ca708bd60f5 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:12.772413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721a56-2d45-4329-8735-274540e14d4e None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:12.885188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:12.891709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721a56-2d45-4329-8735-274540e14d4e None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:12.946439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89446ea6-a84b-492a-a281-2bb9a4745fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:12.947235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89446ea6-a84b-492a-a281-2bb9a4745fca None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:12.947429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89446ea6-a84b-492a-a281-2bb9a4745fca None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:12.948326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89446ea6-a84b-492a-a281-2bb9a4745fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:13.042361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89446ea6-a84b-492a-a281-2bb9a4745fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:13.043853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89446ea6-a84b-492a-a281-2bb9a4745fca None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:13.151832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:13.162787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 149/292] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:13.168498 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d624f-1d93-491f-a001-863204ffb444 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:13.314585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d624f-1d93-491f-a001-863204ffb444 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:13.354413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea813977-c231-4dc1-964c-637db989b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:13.355313 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813977-c231-4dc1-964c-637db989b582 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:13.355598 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813977-c231-4dc1-964c-637db989b582 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:13.355880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813977-c231-4dc1-964c-637db989b582 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:13.357252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea813977-c231-4dc1-964c-637db989b582 None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:13.358773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea813977-c231-4dc1-964c-637db989b582 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:13.361037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 144/293] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:13 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:13.366873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89446ea6-a84b-492a-a281-2bb9a4745fca None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:13.511451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89446ea6-a84b-492a-a281-2bb9a4745fca None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:13.562882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a4a03-4d6f-4cd0-a3dd-4a5181ec5ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:13.563537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a4a03-4d6f-4cd0-a3dd-4a5181ec5ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:13.563822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a4a03-4d6f-4cd0-a3dd-4a5181ec5ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:13.564099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a4a03-4d6f-4cd0-a3dd-4a5181ec5ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:13.565017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a4a03-4d6f-4cd0-a3dd-4a5181ec5ab8 None admin] RBAC: Adding query filter params (role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=edc11b80eb824c8391530bc7bb78d27c, user.id=0869e17e7f6147f58f402ca708bd60f5) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:13.565275 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a4a03-4d6f-4cd0-a3dd-4a5181ec5ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:13.566725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a4a03-4d6f-4cd0-a3dd-4a5181ec5ab8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:13.573505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 150/294] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:13 2022] GET /identity/v3/role_assignments?user.id=0869e17e7f6147f58f402ca708bd60f5&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:14.527054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00d0da-be24-46cf-a409-39db01106e52 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:14.527561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00d0da-be24-46cf-a409-39db01106e52 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:14.527637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00d0da-be24-46cf-a409-39db01106e52 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:14.529297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 145/295] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:14.537656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8fb29-e8f4-466a-82d4-5d52e3b3a615 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:14.538484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8fb29-e8f4-466a-82d4-5d52e3b3a615 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:14.539601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8fb29-e8f4-466a-82d4-5d52e3b3a615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:14.558131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2ca8fb29-e8f4-466a-82d4-5d52e3b3a615 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:14.559636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2ca8fb29-e8f4-466a-82d4-5d52e3b3a615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:14.596527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1968-6d01-4a16-b7f7-8a68180b3b61 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:14.596953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1968-6d01-4a16-b7f7-8a68180b3b61 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:14.597503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1968-6d01-4a16-b7f7-8a68180b3b61 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:14.599357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 146/296] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:26:14.605492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146ee5-a54b-4ff0-8a8e-8726d129b7d3 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:14.605886 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146ee5-a54b-4ff0-8a8e-8726d129b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:14.606369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146ee5-a54b-4ff0-8a8e-8726d129b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:14.625004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-48146ee5-a54b-4ff0-8a8e-8726d129b7d3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:14.626014 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:14.627741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-48146ee5-a54b-4ff0-8a8e-8726d129b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:14.644321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 151/297] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:14.663696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8fb29-e8f4-466a-82d4-5d52e3b3a615 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:14.666589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:14.718862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 147/298] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:14.721810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b9aca-8a57-4024-8417-e4b6bc41259e None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:14.722100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b9aca-8a57-4024-8417-e4b6bc41259e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:14.722378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b9aca-8a57-4024-8417-e4b6bc41259e None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:14.723674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 148/299] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:14.729888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f27ea-4ccf-40c1-bf54-a5957fd3579b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:14.730473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f27ea-4ccf-40c1-bf54-a5957fd3579b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:14.730905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f27ea-4ccf-40c1-bf54-a5957fd3579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:14.748960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-681f27ea-4ccf-40c1-bf54-a5957fd3579b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:14.750182 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-681f27ea-4ccf-40c1-bf54-a5957fd3579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:14.776591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8fb29-e8f4-466a-82d4-5d52e3b3a615 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:14.812944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69420501-79ef-4399-a6dc-b6ed359f9f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:14.813660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69420501-79ef-4399-a6dc-b6ed359f9f94 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:14.813944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69420501-79ef-4399-a6dc-b6ed359f9f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:14.814219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69420501-79ef-4399-a6dc-b6ed359f9f94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:14.819751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 149/300] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:14.825163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69420501-79ef-4399-a6dc-b6ed359f9f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:14.825308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f27ea-4ccf-40c1-bf54-a5957fd3579b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-69420501-79ef-4399-a6dc-b6ed359f9f94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:14.832945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:14.833856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:14.834651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:14.837142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 152/301] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:14.842879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69420501-79ef-4399-a6dc-b6ed359f9f94 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:14.898839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:14.928703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:14.938531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f27ea-4ccf-40c1-bf54-a5957fd3579b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:14.953526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69420501-79ef-4399-a6dc-b6ed359f9f94 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:14.975245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fe125-dd3f-435c-9300-46d4475ed9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:14.976043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fe125-dd3f-435c-9300-46d4475ed9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:14.976357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fe125-dd3f-435c-9300-46d4475ed9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:14.976753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fe125-dd3f-435c-9300-46d4475ed9d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:14.987525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fe125-dd3f-435c-9300-46d4475ed9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:14.990612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e1369-d7e6-4d5f-9e6e-5dd2d6360214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:14.991313 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e1369-d7e6-4d5f-9e6e-5dd2d6360214 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:14.991601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e1369-d7e6-4d5f-9e6e-5dd2d6360214 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:14.991877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e1369-d7e6-4d5f-9e6e-5dd2d6360214 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:14.993714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e1369-d7e6-4d5f-9e6e-5dd2d6360214 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:14.994029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e1369-d7e6-4d5f-9e6e-5dd2d6360214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:14.995435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e1369-d7e6-4d5f-9e6e-5dd2d6360214 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-e75fe125-dd3f-435c-9300-46d4475ed9d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:14.995874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:14.996921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:14.997705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 150/302] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:14.998349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fe125-dd3f-435c-9300-46d4475ed9d1 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:15.006949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 153/303] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:15.009262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e1369-d7e6-4d5f-9e6e-5dd2d6360214 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:15.116778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fe125-dd3f-435c-9300-46d4475ed9d1 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:15.118610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e1369-d7e6-4d5f-9e6e-5dd2d6360214 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:15.134090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:15.154090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058d7e-ba97-4dc8-a4ca-9113594a1a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:15.154894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058d7e-ba97-4dc8-a4ca-9113594a1a1c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.155186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058d7e-ba97-4dc8-a4ca-9113594a1a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.155465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058d7e-ba97-4dc8-a4ca-9113594a1a1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.156055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ada75-6f01-4224-8a53-45e30a1be6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:15.156692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f058d7e-ba97-4dc8-a4ca-9113594a1a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:15.156790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ada75-6f01-4224-8a53-45e30a1be6ed None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.157030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ada75-6f01-4224-8a53-45e30a1be6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.157308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ada75-6f01-4224-8a53-45e30a1be6ed None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.158107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ada75-6f01-4224-8a53-45e30a1be6ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:15.158200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f058d7e-ba97-4dc8-a4ca-9113594a1a1c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:15.158424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ada75-6f01-4224-8a53-45e30a1be6ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:15.164756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 151/304] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:15.164896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ada75-6f01-4224-8a53-45e30a1be6ed None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:15.164988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058d7e-ba97-4dc8-a4ca-9113594a1a1c None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:15.174186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 154/305] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:15.174186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ada75-6f01-4224-8a53-45e30a1be6ed None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:15.195755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:15.278801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ada75-6f01-4224-8a53-45e30a1be6ed None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:15.288420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058d7e-ba97-4dc8-a4ca-9113594a1a1c None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:15.315106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e57bc3-1df1-464d-9154-8fed10797697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:15.315773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e57bc3-1df1-464d-9154-8fed10797697 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.316052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e57bc3-1df1-464d-9154-8fed10797697 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.316576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e57bc3-1df1-464d-9154-8fed10797697 None admin] PATH_INFO: `/v3/groups` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.317047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e57bc3-1df1-464d-9154-8fed10797697 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:15.318498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e57bc3-1df1-464d-9154-8fed10797697 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:15.325266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c5c83-81b3-46cc-992e-9775ff93bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:15.326150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c5c83-81b3-46cc-992e-9775ff93bc1f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.326431 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c5c83-81b3-46cc-992e-9775ff93bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.326706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c5c83-81b3-46cc-992e-9775ff93bc1f None admin] PATH_INFO: `/v3/users/33a085fc3ed7467cbf6ed7eff75b3ffe` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.340949 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c5c83-81b3-46cc-992e-9775ff93bc1f None admin] RBAC: Authorizing `identity:get_user(user_id=33a085fc3ed7467cbf6ed7eff75b3ffe)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:15.342412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c5c83-81b3-46cc-992e-9775ff93bc1f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:15.344096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 152/306] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:15 2022] GET /identity/v3/users/33a085fc3ed7467cbf6ed7eff75b3ffe => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:15.344888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c5c83-81b3-46cc-992e-9775ff93bc1f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:15.387987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 155/307] 10.222.0.74 () {60 vars in 1134 bytes} [Mon May 23 16:26:15 2022] POST /identity/v3/groups => generated 229 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:15.387987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e57bc3-1df1-464d-9154-8fed10797697 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:15.444874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:15.452771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:15.478054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c5c83-81b3-46cc-992e-9775ff93bc1f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:15.516072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d963-5823-4ea2-9e98-26c2e29ddb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:15.516995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d963-5823-4ea2-9e98-26c2e29ddb0c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.517283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d963-5823-4ea2-9e98-26c2e29ddb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.517563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d963-5823-4ea2-9e98-26c2e29ddb0c None admin] PATH_INFO: `/v3/users/8698f285b4e34fa1bc938f259ef597c2` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.519092 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4d963-5823-4ea2-9e98-26c2e29ddb0c None admin] RBAC: Authorizing `identity:get_user(user_id=8698f285b4e34fa1bc938f259ef597c2)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:15.520625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4d963-5823-4ea2-9e98-26c2e29ddb0c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:15.522333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 153/308] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:15 2022] GET /identity/v3/users/8698f285b4e34fa1bc938f259ef597c2 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:15.523728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c6ea7-5135-4800-b6cb-9f45f1472ec1 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.524057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c6ea7-5135-4800-b6cb-9f45f1472ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.524361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c6ea7-5135-4800-b6cb-9f45f1472ec1 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.525719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 154/309] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:15.530751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c6ea7-5135-4800-b6cb-9f45f1472ec1 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:15.532175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e57bc3-1df1-464d-9154-8fed10797697 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:15.571177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983b4a-6d19-4ef9-a70d-9104b3b39ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:15.571823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983b4a-6d19-4ef9-a70d-9104b3b39ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.572102 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983b4a-6d19-4ef9-a70d-9104b3b39ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.572406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983b4a-6d19-4ef9-a70d-9104b3b39ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.573244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983b4a-6d19-4ef9-a70d-9104b3b39ba4 None admin] RBAC: Adding query filter params (role.id=d1262c94c63242cfa4dbc33ff60ac8dd, user.id=33a085fc3ed7467cbf6ed7eff75b3ffe, scope.system=all) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:15.574011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983b4a-6d19-4ef9-a70d-9104b3b39ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:15.575560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983b4a-6d19-4ef9-a70d-9104b3b39ba4 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:15.582372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 156/310] 10.222.0.74 () {56 vars in 1308 bytes} [Mon May 23 16:26:15 2022] GET /identity/v3/role_assignments?user.id=33a085fc3ed7467cbf6ed7eff75b3ffe&scope.system=all&role.id=d1262c94c63242cfa4dbc33ff60ac8dd => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:15.583623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a011c7-e99d-4ea5-9512-c7d8c4c24ac5 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.584035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a011c7-e99d-4ea5-9512-c7d8c4c24ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.585782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a011c7-e99d-4ea5-9512-c7d8c4c24ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.605310 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-91a011c7-e99d-4ea5-9512-c7d8c4c24ac5 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:15.606855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-91a011c7-e99d-4ea5-9512-c7d8c4c24ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:15.662414 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c6ea7-5135-4800-b6cb-9f45f1472ec1 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:15.702066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5beef2-3bef-44c3-80f9-bb8541c4919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:15.703327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5beef2-3bef-44c3-80f9-bb8541c4919a None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.711444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5beef2-3bef-44c3-80f9-bb8541c4919a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.711587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 157/311] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:15.711715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5beef2-3bef-44c3-80f9-bb8541c4919a None admin] PATH_INFO: `/v3/system/users/8698f285b4e34fa1bc938f259ef597c2/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.711715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5beef2-3bef-44c3-80f9-bb8541c4919a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8698f285b4e34fa1bc938f259ef597c2, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:15.711715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5beef2-3bef-44c3-80f9-bb8541c4919a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:15.730875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a011c7-e99d-4ea5-9512-c7d8c4c24ac5 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:15.762203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:15.830496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 155/312] 10.222.0.74 () {58 vars in 1334 bytes} [Mon May 23 16:26:15 2022] PUT /identity/v3/system/users/8698f285b4e34fa1bc938f259ef597c2/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:15.838637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a011c7-e99d-4ea5-9512-c7d8c4c24ac5 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:15.887888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295625-010b-4e99-aec1-e438bbc7b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:15.889282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295625-010b-4e99-aec1-e438bbc7b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:15.889775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295625-010b-4e99-aec1-e438bbc7b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:15.890273 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295625-010b-4e99-aec1-e438bbc7b6b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:15.904927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9295625-010b-4e99-aec1-e438bbc7b6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-f9295625-010b-4e99-aec1-e438bbc7b6b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:15.913901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:15.914917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:15.915720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:15.918706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 158/313] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:15.924375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5beef2-3bef-44c3-80f9-bb8541c4919a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:15.938855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:16.047017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5beef2-3bef-44c3-80f9-bb8541c4919a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:16.083535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87e1c-6030-4b4b-82af-0ad6f1aa0841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:16.084619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87e1c-6030-4b4b-82af-0ad6f1aa0841 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:16.085160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87e1c-6030-4b4b-82af-0ad6f1aa0841 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:16.085720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87e1c-6030-4b4b-82af-0ad6f1aa0841 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:16.087213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87e1c-6030-4b4b-82af-0ad6f1aa0841 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:16.087740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87e1c-6030-4b4b-82af-0ad6f1aa0841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:16.089353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87e1c-6030-4b4b-82af-0ad6f1aa0841 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:16.098665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 156/314] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:16.105397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295625-010b-4e99-aec1-e438bbc7b6b3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:16.203757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:16.221372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295625-010b-4e99-aec1-e438bbc7b6b3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:16.259601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0c426-7030-4033-93f2-47b7d2f6af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:16.260607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c426-7030-4033-93f2-47b7d2f6af38 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:16.260901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c426-7030-4033-93f2-47b7d2f6af38 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:16.261179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c426-7030-4033-93f2-47b7d2f6af38 None admin] PATH_INFO: `/v3/users/130d8cd7110e42a7b4439a9ede6adb10` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:16.262413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0c426-7030-4033-93f2-47b7d2f6af38 None admin] RBAC: Authorizing `identity:get_user(user_id=130d8cd7110e42a7b4439a9ede6adb10)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:16.263871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0c426-7030-4033-93f2-47b7d2f6af38 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:16.265912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 159/315] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:16 2022] GET /identity/v3/users/130d8cd7110e42a7b4439a9ede6adb10 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:16.273972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87e1c-6030-4b4b-82af-0ad6f1aa0841 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:16.352151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:16.394069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87e1c-6030-4b4b-82af-0ad6f1aa0841 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:16.432416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648755fb-0bf4-4d46-8bf5-5eb7a744e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:16.433077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648755fb-0bf4-4d46-8bf5-5eb7a744e755 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:16.433365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648755fb-0bf4-4d46-8bf5-5eb7a744e755 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:16.433647 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648755fb-0bf4-4d46-8bf5-5eb7a744e755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:16.505361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648755fb-0bf4-4d46-8bf5-5eb7a744e755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:16.506741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648755fb-0bf4-4d46-8bf5-5eb7a744e755 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:16.577726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:16.614205 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 157/316] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:16.620290 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0c426-7030-4033-93f2-47b7d2f6af38 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:16.744140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0c426-7030-4033-93f2-47b7d2f6af38 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:16.782143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02819af6-2138-44b4-9794-cc3df30f83af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:16.783013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819af6-2138-44b4-9794-cc3df30f83af None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:16.783301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819af6-2138-44b4-9794-cc3df30f83af None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:16.783579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819af6-2138-44b4-9794-cc3df30f83af None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:16.784798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02819af6-2138-44b4-9794-cc3df30f83af None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:16.786311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02819af6-2138-44b4-9794-cc3df30f83af None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:16.788257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 160/317] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:16 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:16.795167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648755fb-0bf4-4d46-8bf5-5eb7a744e755 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:16.898335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648755fb-0bf4-4d46-8bf5-5eb7a744e755 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:16.933038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02c822-8654-47ce-9176-72e0ac2a460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:16.933696 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02c822-8654-47ce-9176-72e0ac2a460f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:16.933979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02c822-8654-47ce-9176-72e0ac2a460f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:16.934255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02c822-8654-47ce-9176-72e0ac2a460f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:16.935082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02c822-8654-47ce-9176-72e0ac2a460f None admin] RBAC: Adding query filter params (role.id=d1262c94c63242cfa4dbc33ff60ac8dd, scope.project.id=edc11b80eb824c8391530bc7bb78d27c, user.id=130d8cd7110e42a7b4439a9ede6adb10) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:16.935393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02c822-8654-47ce-9176-72e0ac2a460f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:16.936885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02c822-8654-47ce-9176-72e0ac2a460f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:16.943125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 158/318] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:16 2022] GET /identity/v3/role_assignments?user.id=130d8cd7110e42a7b4439a9ede6adb10&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=d1262c94c63242cfa4dbc33ff60ac8dd => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:17.727818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154048c6-d08c-4be3-ad74-a49a847474ed None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:17.728382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154048c6-d08c-4be3-ad74-a49a847474ed None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:17.728497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154048c6-d08c-4be3-ad74-a49a847474ed None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:17.729936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 161/319] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:17.735676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098fb5c-3454-468c-9239-86e5d8dbc33b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:17.736262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098fb5c-3454-468c-9239-86e5d8dbc33b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:17.736262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098fb5c-3454-468c-9239-86e5d8dbc33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:17.753368 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0098fb5c-3454-468c-9239-86e5d8dbc33b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:17.754668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0098fb5c-3454-468c-9239-86e5d8dbc33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:17.785924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:17.828339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 159/320] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:17.849052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154048c6-d08c-4be3-ad74-a49a847474ed None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:17.874875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:17.899418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307e957-4c88-43c5-9630-9a2ef4c303e9 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:17.899716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307e957-4c88-43c5-9630-9a2ef4c303e9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:17.899989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307e957-4c88-43c5-9630-9a2ef4c303e9 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:17.901395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 160/321] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:17.906284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29f29-46b7-4e7a-8388-f43818ecd5fb None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:17.906566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29f29-46b7-4e7a-8388-f43818ecd5fb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:17.906841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29f29-46b7-4e7a-8388-f43818ecd5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:17.923149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-69a29f29-46b7-4e7a-8388-f43818ecd5fb None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:17.924357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-69a29f29-46b7-4e7a-8388-f43818ecd5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:17.957008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154048c6-d08c-4be3-ad74-a49a847474ed None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:17.990945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 161/322] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:17.995579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b81c6-fd74-4d0d-bf77-40ebd3af6ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:17.996707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b81c6-fd74-4d0d-bf77-40ebd3af6ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:17.997129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b81c6-fd74-4d0d-bf77-40ebd3af6ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:17.997542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b81c6-fd74-4d0d-bf77-40ebd3af6ad0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:17.998977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b81c6-fd74-4d0d-bf77-40ebd3af6ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:18.000669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b81c6-fd74-4d0d-bf77-40ebd3af6ad0 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:18.002557 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 162/323] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:18.008818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29f29-46b7-4e7a-8388-f43818ecd5fb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:18.013455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b81c6-fd74-4d0d-bf77-40ebd3af6ad0 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:18.109140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:18.112902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:18.115354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29f29-46b7-4e7a-8388-f43818ecd5fb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:18.122118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b81c6-fd74-4d0d-bf77-40ebd3af6ad0 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:18.151339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a004-6df6-4674-bf7f-1a8a0fc38ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:18.152002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a004-6df6-4674-bf7f-1a8a0fc38ea5 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.152284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a004-6df6-4674-bf7f-1a8a0fc38ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.152584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a004-6df6-4674-bf7f-1a8a0fc38ea5 None admin] PATH_INFO: `/v3/groups` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.153277 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a004-6df6-4674-bf7f-1a8a0fc38ea5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:18.154767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a004-6df6-4674-bf7f-1a8a0fc38ea5 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:18.158782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09de835-0b17-4e39-8e70-001743a581bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:18.159994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09de835-0b17-4e39-8e70-001743a581bb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.160283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09de835-0b17-4e39-8e70-001743a581bb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.160583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09de835-0b17-4e39-8e70-001743a581bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.172152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09de835-0b17-4e39-8e70-001743a581bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-e09de835-0b17-4e39-8e70-001743a581bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:18.179913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:18.181004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:18.181798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 163/324] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:18.186808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09de835-0b17-4e39-8e70-001743a581bb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:18.240647 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 162/325] 10.222.0.74 () {60 vars in 1134 bytes} [Mon May 23 16:26:18 2022] POST /identity/v3/groups => generated 226 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:18.242041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc55d4-60ac-48a5-aaac-bbb08b8424a4 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.242278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc55d4-60ac-48a5-aaac-bbb08b8424a4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.242554 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc55d4-60ac-48a5-aaac-bbb08b8424a4 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.243968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 163/326] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:18.249634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0fb1f-763f-47e4-9446-6ca16844f5b3 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.249923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0fb1f-763f-47e4-9446-6ca16844f5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.250208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0fb1f-763f-47e4-9446-6ca16844f5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.269670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b7b0fb1f-763f-47e4-9446-6ca16844f5b3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:18.270957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b7b0fb1f-763f-47e4-9446-6ca16844f5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:18.296958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09de835-0b17-4e39-8e70-001743a581bb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:18.339387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8fcf3-5234-40d7-a911-cb981015ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:18.340085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8fcf3-5234-40d7-a911-cb981015ee1e None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.340401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8fcf3-5234-40d7-a911-cb981015ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.340681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8fcf3-5234-40d7-a911-cb981015ee1e None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.341451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8fcf3-5234-40d7-a911-cb981015ee1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:18.341768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8fcf3-5234-40d7-a911-cb981015ee1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:18.343197 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8fcf3-5234-40d7-a911-cb981015ee1e None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:18.349262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 164/327] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:18.353163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 164/328] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:18.369696 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0fb1f-763f-47e4-9446-6ca16844f5b3 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:18.377768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8fcf3-5234-40d7-a911-cb981015ee1e None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:18.396183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:18.479153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:18.495252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0fb1f-763f-47e4-9446-6ca16844f5b3 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:18.497311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8fcf3-5234-40d7-a911-cb981015ee1e None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:18.538265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa231da3-189d-4bbf-8d66-38ab8e2a57eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:18.539166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa231da3-189d-4bbf-8d66-38ab8e2a57eb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.539447 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa231da3-189d-4bbf-8d66-38ab8e2a57eb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.539720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa231da3-189d-4bbf-8d66-38ab8e2a57eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.541998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36533d-3fd5-44b0-a341-eefc0766a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:18.543178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36533d-3fd5-44b0-a341-eefc0766a2ba None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.543654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36533d-3fd5-44b0-a341-eefc0766a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.544099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36533d-3fd5-44b0-a341-eefc0766a2ba None admin] PATH_INFO: `/v3/users/33a085fc3ed7467cbf6ed7eff75b3ffe` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.545535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36533d-3fd5-44b0-a341-eefc0766a2ba None admin] RBAC: Authorizing `identity:get_user(user_id=33a085fc3ed7467cbf6ed7eff75b3ffe)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:18.547177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36533d-3fd5-44b0-a341-eefc0766a2ba None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:18.549467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 165/329] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:18 2022] GET /identity/v3/users/33a085fc3ed7467cbf6ed7eff75b3ffe => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:18.553710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa231da3-189d-4bbf-8d66-38ab8e2a57eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:18.556716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36533d-3fd5-44b0-a341-eefc0766a2ba None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-fa231da3-189d-4bbf-8d66-38ab8e2a57eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:18.562218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:18.563097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:18.563891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 165/330] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:18.572158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa231da3-189d-4bbf-8d66-38ab8e2a57eb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:18.672700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:18.680457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36533d-3fd5-44b0-a341-eefc0766a2ba None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:18.706871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa231da3-189d-4bbf-8d66-38ab8e2a57eb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:18.730017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833f4bc-2385-4600-8ccb-66f86d2a5c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:18.730896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833f4bc-2385-4600-8ccb-66f86d2a5c06 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.731172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833f4bc-2385-4600-8ccb-66f86d2a5c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.731448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833f4bc-2385-4600-8ccb-66f86d2a5c06 None admin] PATH_INFO: `/v3/system/users/33a085fc3ed7467cbf6ed7eff75b3ffe/roles/d1262c94c63242cfa4dbc33ff60ac8dd` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.733222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833f4bc-2385-4600-8ccb-66f86d2a5c06 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=33a085fc3ed7467cbf6ed7eff75b3ffe, role_id=d1262c94c63242cfa4dbc33ff60ac8dd)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:18.734628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833f4bc-2385-4600-8ccb-66f86d2a5c06 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:18.752814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52454499-5260-4792-a209-d2f6876fae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:18.752814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52454499-5260-4792-a209-d2f6876fae4e None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.752814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52454499-5260-4792-a209-d2f6876fae4e None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.752814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52454499-5260-4792-a209-d2f6876fae4e None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.753552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52454499-5260-4792-a209-d2f6876fae4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:18.753552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52454499-5260-4792-a209-d2f6876fae4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:18.754492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52454499-5260-4792-a209-d2f6876fae4e None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:18.765339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 166/331] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:18.771464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52454499-5260-4792-a209-d2f6876fae4e None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:18.806977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 166/332] 10.222.0.74 () {58 vars in 1334 bytes} [Mon May 23 16:26:18 2022] PUT /identity/v3/system/users/33a085fc3ed7467cbf6ed7eff75b3ffe/roles/d1262c94c63242cfa4dbc33ff60ac8dd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:18.910170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52454499-5260-4792-a209-d2f6876fae4e None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:18.951048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdb69c-a908-456a-8329-70b8f6563457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:18.951987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb69c-a908-456a-8329-70b8f6563457 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:18.952269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb69c-a908-456a-8329-70b8f6563457 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:18.952569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb69c-a908-456a-8329-70b8f6563457 None admin] PATH_INFO: `/v3/users/8698f285b4e34fa1bc938f259ef597c2` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:18.953833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdb69c-a908-456a-8329-70b8f6563457 None admin] RBAC: Authorizing `identity:get_user(user_id=8698f285b4e34fa1bc938f259ef597c2)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:18.955312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdb69c-a908-456a-8329-70b8f6563457 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:18.964053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 167/333] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:18 2022] GET /identity/v3/users/8698f285b4e34fa1bc938f259ef597c2 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:18.965527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833f4bc-2385-4600-8ccb-66f86d2a5c06 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:18.988546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:19.089204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833f4bc-2385-4600-8ccb-66f86d2a5c06 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:19.127731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4ad35-c2fb-417e-81e7-d94c4f9f246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:19.128455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ad35-c2fb-417e-81e7-d94c4f9f246f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:19.128740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ad35-c2fb-417e-81e7-d94c4f9f246f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:19.129015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ad35-c2fb-417e-81e7-d94c4f9f246f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:19.129857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4ad35-c2fb-417e-81e7-d94c4f9f246f None admin] RBAC: Adding query filter params (role.id=6b4e2fa093c2483a91793d5ad27bc6e8, user.id=8698f285b4e34fa1bc938f259ef597c2, scope.system=all) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:19.130170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4ad35-c2fb-417e-81e7-d94c4f9f246f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:19.131640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4ad35-c2fb-417e-81e7-d94c4f9f246f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:19.145476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 167/334] 10.222.0.74 () {56 vars in 1308 bytes} [Mon May 23 16:26:18 2022] GET /identity/v3/role_assignments?user.id=8698f285b4e34fa1bc938f259ef597c2&scope.system=all&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:20.895794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f0770-cb3c-4037-ab84-67c5e04ce089 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:20.896841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f0770-cb3c-4037-ab84-67c5e04ce089 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:20.897326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f0770-cb3c-4037-ab84-67c5e04ce089 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:20.899234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 168/335] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:20.909903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4954f08-39a8-418c-ada9-ec48c6ca8736 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:20.910842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4954f08-39a8-418c-ada9-ec48c6ca8736 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:20.911312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4954f08-39a8-418c-ada9-ec48c6ca8736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:20.937351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c4954f08-39a8-418c-ada9-ec48c6ca8736 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:20.938926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c4954f08-39a8-418c-ada9-ec48c6ca8736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:21.025371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 168/336] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:21.053211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546246dc-e3e9-409a-a9ac-e95e0fc16c5d None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:21.053841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546246dc-e3e9-409a-a9ac-e95e0fc16c5d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:21.054839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546246dc-e3e9-409a-a9ac-e95e0fc16c5d None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:21.056517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 169/337] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:21.060242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4954f08-39a8-418c-ada9-ec48c6ca8736 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:21.068874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:21.071551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd941e9-66cf-4aa3-98d5-be09c7359ba3 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:21.072424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd941e9-66cf-4aa3-98d5-be09c7359ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:21.072899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd941e9-66cf-4aa3-98d5-be09c7359ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:21.086391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:21.109702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-efd941e9-66cf-4aa3-98d5-be09c7359ba3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:21.111220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-efd941e9-66cf-4aa3-98d5-be09c7359ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:21.234703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4954f08-39a8-418c-ada9-ec48c6ca8736 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:21.262266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 170/338] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:21.309898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a96fd-0270-431e-b0cf-b043bdea9175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:21.310704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a96fd-0270-431e-b0cf-b043bdea9175 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:21.310982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a96fd-0270-431e-b0cf-b043bdea9175 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:21.311254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a96fd-0270-431e-b0cf-b043bdea9175 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:21.329175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a96fd-0270-431e-b0cf-b043bdea9175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:21.331828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd941e9-66cf-4aa3-98d5-be09c7359ba3 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-f17a96fd-0270-431e-b0cf-b043bdea9175 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:21.338744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:21.339650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:21.340472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 169/339] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:21.347139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a96fd-0270-431e-b0cf-b043bdea9175 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:21.472951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:21.536783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd941e9-66cf-4aa3-98d5-be09c7359ba3 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:21.564444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a96fd-0270-431e-b0cf-b043bdea9175 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:21.609203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe44694-5017-467c-8751-ca895e11040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:21.610655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe44694-5017-467c-8751-ca895e11040a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:21.610938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe44694-5017-467c-8751-ca895e11040a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:21.611213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe44694-5017-467c-8751-ca895e11040a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:21.614266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:21.633997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe44694-5017-467c-8751-ca895e11040a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-1fe44694-5017-467c-8751-ca895e11040a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:21.643391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:21.644624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:21.646053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 171/340] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:26:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:21.653205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe44694-5017-467c-8751-ca895e11040a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:21.669083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5007a-0fa4-4f85-9c22-cf0d6d17f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:21.669773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5007a-0fa4-4f85-9c22-cf0d6d17f523 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:21.670067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5007a-0fa4-4f85-9c22-cf0d6d17f523 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:21.670346 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5007a-0fa4-4f85-9c22-cf0d6d17f523 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:21.671113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5007a-0fa4-4f85-9c22-cf0d6d17f523 None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:21.671428 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5007a-0fa4-4f85-9c22-cf0d6d17f523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:21.672860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5007a-0fa4-4f85-9c22-cf0d6d17f523 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:21.688028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 170/341] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:21.693502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5007a-0fa4-4f85-9c22-cf0d6d17f523 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:21.853864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe44694-5017-467c-8751-ca895e11040a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:21.917005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7291e17-03d4-4616-9824-03e091bbbe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:21.917758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7291e17-03d4-4616-9824-03e091bbbe8c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:21.917965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7291e17-03d4-4616-9824-03e091bbbe8c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:21.918337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7291e17-03d4-4616-9824-03e091bbbe8c None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:21.919237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7291e17-03d4-4616-9824-03e091bbbe8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:21.919514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7291e17-03d4-4616-9824-03e091bbbe8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:21.920931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7291e17-03d4-4616-9824-03e091bbbe8c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:21.923816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5007a-0fa4-4f85-9c22-cf0d6d17f523 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:21.935577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 172/342] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:21.936964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397a7d0-bfb5-4d1a-bcdb-80ef14b71ae4 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:21.937255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397a7d0-bfb5-4d1a-bcdb-80ef14b71ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:21.937530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397a7d0-bfb5-4d1a-bcdb-80ef14b71ae4 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:21.939037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 173/343] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:21.945376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397a7d0-bfb5-4d1a-bcdb-80ef14b71ae4 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:21.959728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:21.977399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbb223-5a63-4510-ab0c-3680ee952064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:21.978518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbb223-5a63-4510-ab0c-3680ee952064 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:21.979000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbb223-5a63-4510-ab0c-3680ee952064 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:21.979518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbb223-5a63-4510-ab0c-3680ee952064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.059810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:22.127535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397a7d0-bfb5-4d1a-bcdb-80ef14b71ae4 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:22.157632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbb223-5a63-4510-ab0c-3680ee952064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:22.159050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbb223-5a63-4510-ab0c-3680ee952064 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:22.167840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bcfc4-41a0-4bca-8f02-005b17eb5105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:22.168953 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bcfc4-41a0-4bca-8f02-005b17eb5105 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.169461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bcfc4-41a0-4bca-8f02-005b17eb5105 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.169930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bcfc4-41a0-4bca-8f02-005b17eb5105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.258464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bcfc4-41a0-4bca-8f02-005b17eb5105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:22.260310 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bcfc4-41a0-4bca-8f02-005b17eb5105 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:22.321727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:22.371496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 174/344] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:22.373292 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800aab72-2142-411c-9306-2931ee00ff3a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.373781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800aab72-2142-411c-9306-2931ee00ff3a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.374246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800aab72-2142-411c-9306-2931ee00ff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.391984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-800aab72-2142-411c-9306-2931ee00ff3a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:22.393778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-800aab72-2142-411c-9306-2931ee00ff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:22.423983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 171/345] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:22.425071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbb223-5a63-4510-ab0c-3680ee952064 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:22.477157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:22.493830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 175/346] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:22.495437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7aef7-ac6c-4ee9-a02e-a07524bda15e None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.495878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7aef7-ac6c-4ee9-a02e-a07524bda15e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.496379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7aef7-ac6c-4ee9-a02e-a07524bda15e None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.498272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 176/347] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:22.499430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7aef7-ac6c-4ee9-a02e-a07524bda15e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:22.558209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbb223-5a63-4510-ab0c-3680ee952064 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:22.594694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7329450-65c6-4d83-8904-5575a7587391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:22.595819 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7329450-65c6-4d83-8904-5575a7587391 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.596322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7329450-65c6-4d83-8904-5575a7587391 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.596751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7329450-65c6-4d83-8904-5575a7587391 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.596985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:22.598493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7329450-65c6-4d83-8904-5575a7587391 None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:22.600091 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7329450-65c6-4d83-8904-5575a7587391 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:22.602952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 172/348] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:22 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:22.604287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6fa1a-9b07-43cc-9992-ce3ab271a26b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.604634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6fa1a-9b07-43cc-9992-ce3ab271a26b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.604910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6fa1a-9b07-43cc-9992-ce3ab271a26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.615842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7aef7-ac6c-4ee9-a02e-a07524bda15e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:22.622751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2be6fa1a-9b07-43cc-9992-ce3ab271a26b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:22.624034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2be6fa1a-9b07-43cc-9992-ce3ab271a26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:22.653296 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6255d7-300d-490e-8cfb-bc021b1b5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:22.654639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6255d7-300d-490e-8cfb-bc021b1b5518 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.655146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6255d7-300d-490e-8cfb-bc021b1b5518 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.655627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6255d7-300d-490e-8cfb-bc021b1b5518 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.657123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6255d7-300d-490e-8cfb-bc021b1b5518 None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:22.659040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6255d7-300d-490e-8cfb-bc021b1b5518 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:22.661140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 177/349] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:22 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:22.662114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6255d7-300d-490e-8cfb-bc021b1b5518 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:22.698275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 173/350] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:22.699732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6fa1a-9b07-43cc-9992-ce3ab271a26b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:22.758644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:22.768802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6255d7-300d-490e-8cfb-bc021b1b5518 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:22.812691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bc822-05fe-472b-9522-6b278f0dd64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:22.813592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bc822-05fe-472b-9522-6b278f0dd64b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.813950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bc822-05fe-472b-9522-6b278f0dd64b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.814137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6fa1a-9b07-43cc-9992-ce3ab271a26b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:22.814298 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bc822-05fe-472b-9522-6b278f0dd64b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.829669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bc822-05fe-472b-9522-6b278f0dd64b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-261bc822-05fe-472b-9522-6b278f0dd64b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:22.840922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:22.841900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:22.842771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:22.843420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 178/351] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:22.844023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bc822-05fe-472b-9522-6b278f0dd64b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:22.861214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fe686-dd4e-42bf-b1d5-01ed830bf8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:22.862271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fe686-dd4e-42bf-b1d5-01ed830bf8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.862552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fe686-dd4e-42bf-b1d5-01ed830bf8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.862877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fe686-dd4e-42bf-b1d5-01ed830bf8e3 None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.866408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:22.872603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fe686-dd4e-42bf-b1d5-01ed830bf8e3 None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:22.881788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fe686-dd4e-42bf-b1d5-01ed830bf8e3 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:22.881788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 174/352] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:22 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:22.881788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fe686-dd4e-42bf-b1d5-01ed830bf8e3 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.001121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bc822-05fe-472b-9522-6b278f0dd64b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.022469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:23.037196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fe686-dd4e-42bf-b1d5-01ed830bf8e3 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.041557 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e35573-84fb-42d3-9156-f15732a0a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.042752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e35573-84fb-42d3-9156-f15732a0a956 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.043280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e35573-84fb-42d3-9156-f15732a0a956 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.043747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e35573-84fb-42d3-9156-f15732a0a956 None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.045310 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e35573-84fb-42d3-9156-f15732a0a956 None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.047559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e35573-84fb-42d3-9156-f15732a0a956 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.050225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 179/353] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:22 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:23.051582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e35573-84fb-42d3-9156-f15732a0a956 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.081333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f9f8d-f99c-4fb5-a445-1ee8edf56281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.082702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f9f8d-f99c-4fb5-a445-1ee8edf56281 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.082991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f9f8d-f99c-4fb5-a445-1ee8edf56281 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.083269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f9f8d-f99c-4fb5-a445-1ee8edf56281 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.098178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f9f8d-f99c-4fb5-a445-1ee8edf56281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-db0f9f8d-f99c-4fb5-a445-1ee8edf56281 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:23.109112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:23.110040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:23.111393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 175/354] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:23.112123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f9f8d-f99c-4fb5-a445-1ee8edf56281 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.160873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:23.189723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e35573-84fb-42d3-9156-f15732a0a956 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.239817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d8ab-a345-478f-a185-ac9a47864626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.240568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d8ab-a345-478f-a185-ac9a47864626 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.240859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d8ab-a345-478f-a185-ac9a47864626 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.241139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d8ab-a345-478f-a185-ac9a47864626 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.244529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d8ab-a345-478f-a185-ac9a47864626 None admin] RBAC: Adding query filter params (name=member) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:23.244529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d8ab-a345-478f-a185-ac9a47864626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.244529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d8ab-a345-478f-a185-ac9a47864626 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.255105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 180/355] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:23.255849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d8ab-a345-478f-a185-ac9a47864626 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.266926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f9f8d-f99c-4fb5-a445-1ee8edf56281 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.312790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79846082-0488-4874-a133-12cc72561ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.313687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79846082-0488-4874-a133-12cc72561ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.314140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79846082-0488-4874-a133-12cc72561ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.314557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79846082-0488-4874-a133-12cc72561ef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.315512 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79846082-0488-4874-a133-12cc72561ef4 None admin] RBAC: Adding query filter params (group.id=9959c4bd4bcc47a2b29d1095f7b5bebc, role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=07ec6eba37f64872812e5e3802a57be0) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:23.315972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79846082-0488-4874-a133-12cc72561ef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.317580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79846082-0488-4874-a133-12cc72561ef4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.330424 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 176/356] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:23 2022] GET /identity/v3/role_assignments?group.id=9959c4bd4bcc47a2b29d1095f7b5bebc&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:23.331724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79846082-0488-4874-a133-12cc72561ef4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.351227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:23.403768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d8ab-a345-478f-a185-ac9a47864626 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.442415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6ee66-5fb6-4b46-a5f6-1bba5ca33d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.443418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6ee66-5fb6-4b46-a5f6-1bba5ca33d40 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.443890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6ee66-5fb6-4b46-a5f6-1bba5ca33d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.444174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6ee66-5fb6-4b46-a5f6-1bba5ca33d40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.445608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6ee66-5fb6-4b46-a5f6-1bba5ca33d40 None admin] RBAC: Adding query filter params (group.id=9959c4bd4bcc47a2b29d1095f7b5bebc, role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=07ec6eba37f64872812e5e3802a57be0) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:23.447238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6ee66-5fb6-4b46-a5f6-1bba5ca33d40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.447470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6ee66-5fb6-4b46-a5f6-1bba5ca33d40 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.453721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 181/357] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:23 2022] GET /identity/v3/role_assignments?group.id=9959c4bd4bcc47a2b29d1095f7b5bebc&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:23.456336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908c966-5850-4b07-8777-19a4a60ca9a4 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.456636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908c966-5850-4b07-8777-19a4a60ca9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.456913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908c966-5850-4b07-8777-19a4a60ca9a4 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.458325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 182/358] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:23.459191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908c966-5850-4b07-8777-19a4a60ca9a4 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.477120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:23.479789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79846082-0488-4874-a133-12cc72561ef4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.535729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88047a4-17ee-4b9c-9ee8-12bb59dd3a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.536970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88047a4-17ee-4b9c-9ee8-12bb59dd3a84 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.537741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88047a4-17ee-4b9c-9ee8-12bb59dd3a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.538234 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88047a4-17ee-4b9c-9ee8-12bb59dd3a84 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.540348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88047a4-17ee-4b9c-9ee8-12bb59dd3a84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:23.540932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88047a4-17ee-4b9c-9ee8-12bb59dd3a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.543389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88047a4-17ee-4b9c-9ee8-12bb59dd3a84 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.557944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 177/359] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:23.559780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69bf9-7a1d-41af-8c53-f4e852d8b782 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.560278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69bf9-7a1d-41af-8c53-f4e852d8b782 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.560803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69bf9-7a1d-41af-8c53-f4e852d8b782 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.562706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 178/360] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:23.564063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691a63-621e-4c97-bb8a-149a71b9c82d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.564661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691a63-621e-4c97-bb8a-149a71b9c82d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.565152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691a63-621e-4c97-bb8a-149a71b9c82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.591447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-35691a63-621e-4c97-bb8a-149a71b9c82d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:23.592848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-35691a63-621e-4c97-bb8a-149a71b9c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:23.613707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908c966-5850-4b07-8777-19a4a60ca9a4 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.653623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1b81-5e5b-4afe-9e9d-05f3a4614d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.655165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1b81-5e5b-4afe-9e9d-05f3a4614d93 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.655677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1b81-5e5b-4afe-9e9d-05f3a4614d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.656176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1b81-5e5b-4afe-9e9d-05f3a4614d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.681730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 179/361] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:23.683023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691a63-621e-4c97-bb8a-149a71b9c82d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.692158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:23.752400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d1b81-5e5b-4afe-9e9d-05f3a4614d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.754144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d1b81-5e5b-4afe-9e9d-05f3a4614d93 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.769541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:23.812772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691a63-621e-4c97-bb8a-149a71b9c82d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.854210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd34155-6e38-4886-8188-57a834ea6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.855287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd34155-6e38-4886-8188-57a834ea6b32 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.856015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd34155-6e38-4886-8188-57a834ea6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.856350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd34155-6e38-4886-8188-57a834ea6b32 None admin] PATH_INFO: `/v3/users/33a085fc3ed7467cbf6ed7eff75b3ffe` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.858127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd34155-6e38-4886-8188-57a834ea6b32 None admin] RBAC: Authorizing `identity:get_user(user_id=33a085fc3ed7467cbf6ed7eff75b3ffe)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.860057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd34155-6e38-4886-8188-57a834ea6b32 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.862522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 180/362] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:26:23 2022] GET /identity/v3/users/33a085fc3ed7467cbf6ed7eff75b3ffe => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:23.863967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcf717-05f2-4176-a0d0-a8dac8fa9dd6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.864252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcf717-05f2-4176-a0d0-a8dac8fa9dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.864556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcf717-05f2-4176-a0d0-a8dac8fa9dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.886772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-57fcf717-05f2-4176-a0d0-a8dac8fa9dd6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:23.887968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-57fcf717-05f2-4176-a0d0-a8dac8fa9dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:23.892470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 183/363] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:23.893660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1b81-5e5b-4afe-9e9d-05f3a4614d93 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.979693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 181/364] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:23.980578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcf717-05f2-4176-a0d0-a8dac8fa9dd6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.984968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.022588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1b81-5e5b-4afe-9e9d-05f3a4614d93 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.035318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.070616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53c71c-a520-46bd-9468-f7bb78c6e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.071352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c71c-a520-46bd-9468-f7bb78c6e7db None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.071641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c71c-a520-46bd-9468-f7bb78c6e7db None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.071914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c71c-a520-46bd-9468-f7bb78c6e7db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.087866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53c71c-a520-46bd-9468-f7bb78c6e7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-8c53c71c-a520-46bd-9468-f7bb78c6e7db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:24.095979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:24.096905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:24.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 184/365] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:26:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:24.098898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53c71c-a520-46bd-9468-f7bb78c6e7db None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.120603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcf717-05f2-4176-a0d0-a8dac8fa9dd6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.174896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a5ce-6c0b-4bdc-a8c7-5bae97057a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.176100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a5ce-6c0b-4bdc-a8c7-5bae97057a58 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.176612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a5ce-6c0b-4bdc-a8c7-5bae97057a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.177100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a5ce-6c0b-4bdc-a8c7-5bae97057a58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.178175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a5ce-6c0b-4bdc-a8c7-5bae97057a58 None admin] RBAC: Adding query filter params (role.id=d1262c94c63242cfa4dbc33ff60ac8dd, user.id=33a085fc3ed7467cbf6ed7eff75b3ffe, scope.system=all) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:24.178831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a5ce-6c0b-4bdc-a8c7-5bae97057a58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.183197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a5ce-6c0b-4bdc-a8c7-5bae97057a58 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.197675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 182/366] 10.222.0.74 () {56 vars in 1308 bytes} [Mon May 23 16:26:23 2022] GET /identity/v3/role_assignments?user.id=33a085fc3ed7467cbf6ed7eff75b3ffe&scope.system=all&role.id=d1262c94c63242cfa4dbc33ff60ac8dd => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:24.198839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a5ce-6c0b-4bdc-a8c7-5bae97057a58 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.261943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53c71c-a520-46bd-9468-f7bb78c6e7db None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.338250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.342035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31ce16-9bd8-4c91-be2c-d5cc6bbb4c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.342987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31ce16-9bd8-4c91-be2c-d5cc6bbb4c6f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.343270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31ce16-9bd8-4c91-be2c-d5cc6bbb4c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.343548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31ce16-9bd8-4c91-be2c-d5cc6bbb4c6f None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.345991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31ce16-9bd8-4c91-be2c-d5cc6bbb4c6f None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.347497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31ce16-9bd8-4c91-be2c-d5cc6bbb4c6f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.353192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 185/367] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:24 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:24.354057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31ce16-9bd8-4c91-be2c-d5cc6bbb4c6f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.421747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a5ce-6c0b-4bdc-a8c7-5bae97057a58 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.448211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.471895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e5672-44e2-40f7-ab32-fb4a1462ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.472748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e5672-44e2-40f7-ab32-fb4a1462ecde None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.473037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e5672-44e2-40f7-ab32-fb4a1462ecde None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.473362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e5672-44e2-40f7-ab32-fb4a1462ecde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.486967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e5672-44e2-40f7-ab32-fb4a1462ecde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-186e5672-44e2-40f7-ab32-fb4a1462ecde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:24.496041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:24.497026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:24.497816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 183/368] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:24.498489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e5672-44e2-40f7-ab32-fb4a1462ecde None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.531331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31ce16-9bd8-4c91-be2c-d5cc6bbb4c6f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.571859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9438f7a-7398-416e-b614-9b62518a42b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.572944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9438f7a-7398-416e-b614-9b62518a42b7 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.573449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9438f7a-7398-416e-b614-9b62518a42b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.573941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9438f7a-7398-416e-b614-9b62518a42b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.575007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9438f7a-7398-416e-b614-9b62518a42b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:24.575614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9438f7a-7398-416e-b614-9b62518a42b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.577236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9438f7a-7398-416e-b614-9b62518a42b7 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.587012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 186/369] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:24.588211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9438f7a-7398-416e-b614-9b62518a42b7 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.612174 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e5672-44e2-40f7-ab32-fb4a1462ecde None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.637960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.650228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7840f57-6ad8-4a3e-8e12-3b16b788cb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.651270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7840f57-6ad8-4a3e-8e12-3b16b788cb14 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.651389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7840f57-6ad8-4a3e-8e12-3b16b788cb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.651634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7840f57-6ad8-4a3e-8e12-3b16b788cb14 None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.653568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7840f57-6ad8-4a3e-8e12-3b16b788cb14 None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.655040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7840f57-6ad8-4a3e-8e12-3b16b788cb14 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.657031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 184/370] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:24 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:24.657820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7840f57-6ad8-4a3e-8e12-3b16b788cb14 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.702723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.707323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9438f7a-7398-416e-b614-9b62518a42b7 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.745795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7e71a-a202-4fa5-a0cf-96a49d7b0778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.746480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7e71a-a202-4fa5-a0cf-96a49d7b0778 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.746766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7e71a-a202-4fa5-a0cf-96a49d7b0778 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.747148 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7e71a-a202-4fa5-a0cf-96a49d7b0778 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.748011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7e71a-a202-4fa5-a0cf-96a49d7b0778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:24.748336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7e71a-a202-4fa5-a0cf-96a49d7b0778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.749733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7e71a-a202-4fa5-a0cf-96a49d7b0778 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.759810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 187/371] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:24.760585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7e71a-a202-4fa5-a0cf-96a49d7b0778 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.771975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7840f57-6ad8-4a3e-8e12-3b16b788cb14 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.819548 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c80f58-d1d2-4784-85ca-658f5988c7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.820253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c80f58-d1d2-4784-85ca-658f5988c7ba None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.820705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c80f58-d1d2-4784-85ca-658f5988c7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.820985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c80f58-d1d2-4784-85ca-658f5988c7ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.886580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.889909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7e71a-a202-4fa5-a0cf-96a49d7b0778 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.899766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c80f58-d1d2-4784-85ca-658f5988c7ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.901595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c80f58-d1d2-4784-85ca-658f5988c7ba None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.927088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c16ac-104a-47dd-8435-38b85a35b9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.927765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c16ac-104a-47dd-8435-38b85a35b9ae None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.928071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c16ac-104a-47dd-8435-38b85a35b9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.928388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c16ac-104a-47dd-8435-38b85a35b9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.929818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c16ac-104a-47dd-8435-38b85a35b9ae None admin] RBAC: Adding query filter params (group.id=9959c4bd4bcc47a2b29d1095f7b5bebc, role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=edc11b80eb824c8391530bc7bb78d27c) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:24.930131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c16ac-104a-47dd-8435-38b85a35b9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.933567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c16ac-104a-47dd-8435-38b85a35b9ae None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.939965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 188/372] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:24 2022] GET /identity/v3/role_assignments?group.id=9959c4bd4bcc47a2b29d1095f7b5bebc&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:24.940810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c16ac-104a-47dd-8435-38b85a35b9ae None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.974152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:25.027676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 185/373] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:25.034163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c80f58-d1d2-4784-85ca-658f5988c7ba None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.074489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c16ac-104a-47dd-8435-38b85a35b9ae None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.114280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f26e7-295d-4d99-b263-3403ee1e44d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.115029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f26e7-295d-4d99-b263-3403ee1e44d2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.115252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f26e7-295d-4d99-b263-3403ee1e44d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.115500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f26e7-295d-4d99-b263-3403ee1e44d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.168954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:25.185089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c80f58-d1d2-4784-85ca-658f5988c7ba None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.200414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f26e7-295d-4d99-b263-3403ee1e44d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.202036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f26e7-295d-4d99-b263-3403ee1e44d2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.237752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:25.242099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7150f-036a-4854-aac8-c96479cbb699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.243558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7150f-036a-4854-aac8-c96479cbb699 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.244194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7150f-036a-4854-aac8-c96479cbb699 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.247761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7150f-036a-4854-aac8-c96479cbb699 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.247761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7150f-036a-4854-aac8-c96479cbb699 None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.248256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7150f-036a-4854-aac8-c96479cbb699 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.251371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 186/374] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:25.257837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7150f-036a-4854-aac8-c96479cbb699 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.356823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 189/375] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:25.362180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f26e7-295d-4d99-b263-3403ee1e44d2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.437673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7150f-036a-4854-aac8-c96479cbb699 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.485496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79eae0d-f95e-4d05-9114-791765a93ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.486391 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79eae0d-f95e-4d05-9114-791765a93ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.486691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79eae0d-f95e-4d05-9114-791765a93ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.486944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79eae0d-f95e-4d05-9114-791765a93ab6 None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.488117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79eae0d-f95e-4d05-9114-791765a93ab6 None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.489687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79eae0d-f95e-4d05-9114-791765a93ab6 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.492247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 187/376] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:25.497732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79eae0d-f95e-4d05-9114-791765a93ab6 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.528755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:25.596141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f26e7-295d-4d99-b263-3403ee1e44d2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.605884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79eae0d-f95e-4d05-9114-791765a93ab6 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.628194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:25.649169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03eb6-5308-4521-837a-5bf8e4690beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.649845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03eb6-5308-4521-837a-5bf8e4690beb None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.650135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03eb6-5308-4521-837a-5bf8e4690beb None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.650409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03eb6-5308-4521-837a-5bf8e4690beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.651254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac03eb6-5308-4521-837a-5bf8e4690beb None admin] RBAC: Adding query filter params (group.id=9959c4bd4bcc47a2b29d1095f7b5bebc, role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=edc11b80eb824c8391530bc7bb78d27c) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:25.651569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac03eb6-5308-4521-837a-5bf8e4690beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.653072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac03eb6-5308-4521-837a-5bf8e4690beb None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.656303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30268-14c8-4484-8b98-924a35046f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.657189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30268-14c8-4484-8b98-924a35046f84 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.657469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30268-14c8-4484-8b98-924a35046f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.657742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30268-14c8-4484-8b98-924a35046f84 None admin] PATH_INFO: `/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.659473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb30268-14c8-4484-8b98-924a35046f84 None admin] RBAC: Authorizing `identity:get_project(project_id=a06edcae6b7a4521b29d4cfac1cfa2c1)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.660985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb30268-14c8-4484-8b98-924a35046f84 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.663987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 190/377] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1 => generated 344 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:25.668253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 188/378] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/role_assignments?group.id=9959c4bd4bcc47a2b29d1095f7b5bebc&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:25.669210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30268-14c8-4484-8b98-924a35046f84 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.781655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30268-14c8-4484-8b98-924a35046f84 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.826745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fed17-93fa-4bd4-aac5-f191cf809207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.827633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fed17-93fa-4bd4-aac5-f191cf809207 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.827915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fed17-93fa-4bd4-aac5-f191cf809207 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.828190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fed17-93fa-4bd4-aac5-f191cf809207 None admin] PATH_INFO: `/v3/groups/86757463e4dd48e6b56ec79f0093251d` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.834954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fed17-93fa-4bd4-aac5-f191cf809207 None admin] RBAC: Authorizing `identity:get_group(group_id=86757463e4dd48e6b56ec79f0093251d)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.836502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fed17-93fa-4bd4-aac5-f191cf809207 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.838324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 191/379] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/groups/86757463e4dd48e6b56ec79f0093251d => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:25.844473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03eb6-5308-4521-837a-5bf8e4690beb None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.959934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:25.970378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03eb6-5308-4521-837a-5bf8e4690beb None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.010926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e6556-4602-4fc3-aa96-9f94444cc9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.011960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e6556-4602-4fc3-aa96-9f94444cc9bc None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.012566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e6556-4602-4fc3-aa96-9f94444cc9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.013063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e6556-4602-4fc3-aa96-9f94444cc9bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.014117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e6556-4602-4fc3-aa96-9f94444cc9bc None admin] RBAC: Adding query filter params (group.id=86757463e4dd48e6b56ec79f0093251d, role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=a06edcae6b7a4521b29d4cfac1cfa2c1) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:26.014628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e6556-4602-4fc3-aa96-9f94444cc9bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.016284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e6556-4602-4fc3-aa96-9f94444cc9bc None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.023287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 189/380] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/role_assignments?group.id=86757463e4dd48e6b56ec79f0093251d&scope.project.id=a06edcae6b7a4521b29d4cfac1cfa2c1&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:26.207209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47771f34-20f5-4353-99df-5044907ce2a6 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.207209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47771f34-20f5-4353-99df-5044907ce2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.207784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47771f34-20f5-4353-99df-5044907ce2a6 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.208814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 192/381] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:26.222154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003802b-a597-4363-bdc8-da969bfce62e None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.223151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003802b-a597-4363-bdc8-da969bfce62e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.223628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003802b-a597-4363-bdc8-da969bfce62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.245870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4003802b-a597-4363-bdc8-da969bfce62e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:26.247469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4003802b-a597-4363-bdc8-da969bfce62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:26.331830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 190/382] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:26.359582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47771f34-20f5-4353-99df-5044907ce2a6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.442120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:26.454005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac905-57ce-481a-9f16-8c06347dbac0 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.468468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac905-57ce-481a-9f16-8c06347dbac0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.468468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac905-57ce-481a-9f16-8c06347dbac0 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.468468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 191/383] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:26.468468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa57d1-fe9c-4aaf-b21e-840b3f9f6555 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.468468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa57d1-fe9c-4aaf-b21e-840b3f9f6555 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.468468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa57d1-fe9c-4aaf-b21e-840b3f9f6555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.487885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-abaa57d1-fe9c-4aaf-b21e-840b3f9f6555 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:26.489450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-abaa57d1-fe9c-4aaf-b21e-840b3f9f6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:26.495882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47771f34-20f5-4353-99df-5044907ce2a6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.533224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220872b-84c9-4aad-ba19-c01268c3ad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.534609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220872b-84c9-4aad-ba19-c01268c3ad5e None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.534900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220872b-84c9-4aad-ba19-c01268c3ad5e None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.535178 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220872b-84c9-4aad-ba19-c01268c3ad5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.547642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220872b-84c9-4aad-ba19-c01268c3ad5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-8220872b-84c9-4aad-ba19-c01268c3ad5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:26.557411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:26.558359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:26.559152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:26.559748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 193/384] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:26.565671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220872b-84c9-4aad-ba19-c01268c3ad5e None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.636106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 192/385] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:26.660065 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa57d1-fe9c-4aaf-b21e-840b3f9f6555 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.678532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:26.692464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220872b-84c9-4aad-ba19-c01268c3ad5e None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.715510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:26.734810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d60b-167e-4b63-9bb5-55031d93f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.735406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d60b-167e-4b63-9bb5-55031d93f547 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.735692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d60b-167e-4b63-9bb5-55031d93f547 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.735972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d60b-167e-4b63-9bb5-55031d93f547 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.736759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75d60b-167e-4b63-9bb5-55031d93f547 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:26.737066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75d60b-167e-4b63-9bb5-55031d93f547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.738688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75d60b-167e-4b63-9bb5-55031d93f547 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.748244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 194/386] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:26.754147 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d60b-167e-4b63-9bb5-55031d93f547 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.795777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa57d1-fe9c-4aaf-b21e-840b3f9f6555 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.838815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de4ded-6d78-420d-b0ba-fb5a91e18159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.839626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de4ded-6d78-420d-b0ba-fb5a91e18159 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.839904 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de4ded-6d78-420d-b0ba-fb5a91e18159 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.840176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de4ded-6d78-420d-b0ba-fb5a91e18159 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.863821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de4ded-6d78-420d-b0ba-fb5a91e18159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-d1de4ded-6d78-420d-b0ba-fb5a91e18159 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:26.872878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:26.875019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:26.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:26.882654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 193/387] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:26.882654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de4ded-6d78-420d-b0ba-fb5a91e18159 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.898397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d60b-167e-4b63-9bb5-55031d93f547 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.943274 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9cf5a-a981-44ec-b6eb-43709be64b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.944193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9cf5a-a981-44ec-b6eb-43709be64b24 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.944587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9cf5a-a981-44ec-b6eb-43709be64b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.945794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9cf5a-a981-44ec-b6eb-43709be64b24 None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.947076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9cf5a-a981-44ec-b6eb-43709be64b24 None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.948555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9cf5a-a981-44ec-b6eb-43709be64b24 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.950846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 195/388] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:26.955932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9cf5a-a981-44ec-b6eb-43709be64b24 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.036813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:27.048637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:27.088558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de4ded-6d78-420d-b0ba-fb5a91e18159 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.157613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9cf5a-a981-44ec-b6eb-43709be64b24 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.160212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581602b2-e003-418b-b577-9e40df46e5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.160970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581602b2-e003-418b-b577-9e40df46e5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.161255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581602b2-e003-418b-b577-9e40df46e5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.161587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581602b2-e003-418b-b577-9e40df46e5c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.162352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581602b2-e003-418b-b577-9e40df46e5c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:27.162694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581602b2-e003-418b-b577-9e40df46e5c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.165236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581602b2-e003-418b-b577-9e40df46e5c4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.185239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 194/389] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:27.192957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581602b2-e003-418b-b577-9e40df46e5c4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.234498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ad2c6-da8e-47ef-b058-0e8c1571ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.235388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ad2c6-da8e-47ef-b058-0e8c1571ab95 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.235677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ad2c6-da8e-47ef-b058-0e8c1571ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.235962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ad2c6-da8e-47ef-b058-0e8c1571ab95 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.240225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ad2c6-da8e-47ef-b058-0e8c1571ab95 None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.242213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ad2c6-da8e-47ef-b058-0e8c1571ab95 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.249750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 196/390] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:27.255166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ad2c6-da8e-47ef-b058-0e8c1571ab95 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.350650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581602b2-e003-418b-b577-9e40df46e5c4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.391080 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19fac3-dc9b-4348-98ea-b2a9153d03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.391961 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19fac3-dc9b-4348-98ea-b2a9153d03c0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.392248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19fac3-dc9b-4348-98ea-b2a9153d03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.392561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19fac3-dc9b-4348-98ea-b2a9153d03c0 None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.396564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19fac3-dc9b-4348-98ea-b2a9153d03c0 None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.399251 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19fac3-dc9b-4348-98ea-b2a9153d03c0 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.400957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 195/391] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:27 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:27.427423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19fac3-dc9b-4348-98ea-b2a9153d03c0 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.431965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:27.488914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ad2c6-da8e-47ef-b058-0e8c1571ab95 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.508509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:27.549553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19fac3-dc9b-4348-98ea-b2a9153d03c0 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.573613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e72643-f851-4559-af1e-9f2976512880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.574653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e72643-f851-4559-af1e-9f2976512880 None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.574939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e72643-f851-4559-af1e-9f2976512880 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.575318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e72643-f851-4559-af1e-9f2976512880 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0/groups/9959c4bd4bcc47a2b29d1095f7b5bebc/roles/c07ef3c8c1574bb987c394026b04fb39` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.581063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e72643-f851-4559-af1e-9f2976512880 None admin] RBAC: Authorizing `identity:create_grant(project_id=07ec6eba37f64872812e5e3802a57be0, group_id=9959c4bd4bcc47a2b29d1095f7b5bebc, role_id=c07ef3c8c1574bb987c394026b04fb39)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.582555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e72643-f851-4559-af1e-9f2976512880 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.588959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13143b2b-2c80-492f-ad93-e36dfd4c2dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.589833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13143b2b-2c80-492f-ad93-e36dfd4c2dbc None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.590117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13143b2b-2c80-492f-ad93-e36dfd4c2dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.590395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13143b2b-2c80-492f-ad93-e36dfd4c2dbc None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.592095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13143b2b-2c80-492f-ad93-e36dfd4c2dbc None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.593661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13143b2b-2c80-492f-ad93-e36dfd4c2dbc None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.595678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 196/392] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:27 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:27.602897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13143b2b-2c80-492f-ad93-e36dfd4c2dbc None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.675314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 197/393] 10.222.0.74 () {58 vars in 1442 bytes} [Mon May 23 16:26:27 2022] PUT /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0/groups/9959c4bd4bcc47a2b29d1095f7b5bebc/roles/c07ef3c8c1574bb987c394026b04fb39 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:26:27.688741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:27.716438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13143b2b-2c80-492f-ad93-e36dfd4c2dbc None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.764923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced797f-08d3-4710-951c-945c7be73b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.765826 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced797f-08d3-4710-951c-945c7be73b57 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.766109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced797f-08d3-4710-951c-945c7be73b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.766389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced797f-08d3-4710-951c-945c7be73b57 None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0/groups/9959c4bd4bcc47a2b29d1095f7b5bebc/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.768678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced797f-08d3-4710-951c-945c7be73b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=07ec6eba37f64872812e5e3802a57be0, group_id=9959c4bd4bcc47a2b29d1095f7b5bebc, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.770124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced797f-08d3-4710-951c-945c7be73b57 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.904549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 197/394] 10.222.0.74 () {58 vars in 1442 bytes} [Mon May 23 16:26:27 2022] PUT /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0/groups/9959c4bd4bcc47a2b29d1095f7b5bebc/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:26:28.101958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b60d95-a663-41c8-aacd-cb218b47df7f None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.102350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b60d95-a663-41c8-aacd-cb218b47df7f None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.102553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b60d95-a663-41c8-aacd-cb218b47df7f None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.104204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 198/395] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:28.111774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0b34a-dbab-4a29-a5a7-4fcb0338fbac None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.111774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0b34a-dbab-4a29-a5a7-4fcb0338fbac None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.111774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0b34a-dbab-4a29-a5a7-4fcb0338fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.130933 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-bac0b34a-dbab-4a29-a5a7-4fcb0338fbac None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:28.133652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-bac0b34a-dbab-4a29-a5a7-4fcb0338fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:28.218980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 198/396] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:28.252564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b60d95-a663-41c8-aacd-cb218b47df7f None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:28.380676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b60d95-a663-41c8-aacd-cb218b47df7f None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:28.427379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f6830-8400-4f12-be2e-98aaf6f8421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:28.428206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6830-8400-4f12-be2e-98aaf6f8421b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.428531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6830-8400-4f12-be2e-98aaf6f8421b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.429334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6830-8400-4f12-be2e-98aaf6f8421b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.442465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f6830-8400-4f12-be2e-98aaf6f8421b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-c43f6830-8400-4f12-be2e-98aaf6f8421b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:28.451883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:28.452840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:28.453733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 199/397] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:28.462593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0b34a-dbab-4a29-a5a7-4fcb0338fbac None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:28.571495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:28.622821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0b34a-dbab-4a29-a5a7-4fcb0338fbac None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:28.672620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca043e1-282e-4467-b1d7-fbf56885d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:28.673305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca043e1-282e-4467-b1d7-fbf56885d20d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.673591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca043e1-282e-4467-b1d7-fbf56885d20d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.673870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca043e1-282e-4467-b1d7-fbf56885d20d None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.674629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca043e1-282e-4467-b1d7-fbf56885d20d None admin] RBAC: Adding query filter params (name=member) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:28.674941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca043e1-282e-4467-b1d7-fbf56885d20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:28.676342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca043e1-282e-4467-b1d7-fbf56885d20d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:28.692441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 199/398] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:28.698878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f6830-8400-4f12-be2e-98aaf6f8421b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:28.705602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01550646-be88-485a-b4c1-e06577c2c738 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.705889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01550646-be88-485a-b4c1-e06577c2c738 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.706170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01550646-be88-485a-b4c1-e06577c2c738 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.707809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 200/399] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:28.713906 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078dbf5-2cc9-46ec-9cbc-487b04e38a96 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.714200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078dbf5-2cc9-46ec-9cbc-487b04e38a96 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.714486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078dbf5-2cc9-46ec-9cbc-487b04e38a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.748713 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:28.749313 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4078dbf5-2cc9-46ec-9cbc-487b04e38a96 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:28.750529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4078dbf5-2cc9-46ec-9cbc-487b04e38a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:28.834056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f6830-8400-4f12-be2e-98aaf6f8421b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:28.882630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839a0d5-ddd1-473c-8d5d-2b53f90fc67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:28.883502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839a0d5-ddd1-473c-8d5d-2b53f90fc67c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.883781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839a0d5-ddd1-473c-8d5d-2b53f90fc67c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.884055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839a0d5-ddd1-473c-8d5d-2b53f90fc67c None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.885810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 201/400] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:28.886324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839a0d5-ddd1-473c-8d5d-2b53f90fc67c None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:28.887183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146078b2-fb3e-47ff-85a6-9ce3a3bc4069 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.887476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146078b2-fb3e-47ff-85a6-9ce3a3bc4069 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.887760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839a0d5-ddd1-473c-8d5d-2b53f90fc67c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:28.887924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146078b2-fb3e-47ff-85a6-9ce3a3bc4069 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.889375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 202/401] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:28.889715 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 200/402] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:28 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:28.894890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bfe9d-d19d-4df5-aa85-981b0d09ae45 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.895167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839a0d5-ddd1-473c-8d5d-2b53f90fc67c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:28.895295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bfe9d-d19d-4df5-aa85-981b0d09ae45 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.895448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bfe9d-d19d-4df5-aa85-981b0d09ae45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.913563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-fb3bfe9d-d19d-4df5-aa85-981b0d09ae45 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:28.914857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fb3bfe9d-d19d-4df5-aa85-981b0d09ae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:28.977553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:28.997411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 203/403] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:29.004596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bfe9d-d19d-4df5-aa85-981b0d09ae45 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.029633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839a0d5-ddd1-473c-8d5d-2b53f90fc67c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.031199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:29.077710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51deeac7-f529-48bc-adc4-6c97c4a035ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.078831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deeac7-f529-48bc-adc4-6c97c4a035ae None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.079503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deeac7-f529-48bc-adc4-6c97c4a035ae None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.079780 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deeac7-f529-48bc-adc4-6c97c4a035ae None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.081014 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51deeac7-f529-48bc-adc4-6c97c4a035ae None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.083090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51deeac7-f529-48bc-adc4-6c97c4a035ae None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.086424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 201/404] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:28 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:29.087774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51deeac7-f529-48bc-adc4-6c97c4a035ae None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.138816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bfe9d-d19d-4df5-aa85-981b0d09ae45 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.177561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf882bc4-a973-4dc4-b081-7b7fda518e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.178377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf882bc4-a973-4dc4-b081-7b7fda518e26 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.178658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf882bc4-a973-4dc4-b081-7b7fda518e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.180054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf882bc4-a973-4dc4-b081-7b7fda518e26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.192078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf882bc4-a973-4dc4-b081-7b7fda518e26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-cf882bc4-a973-4dc4-b081-7b7fda518e26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:29.201957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:29.202873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:29.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 204/405] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:26:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:29.204385 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf882bc4-a973-4dc4-b081-7b7fda518e26 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.224317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51deeac7-f529-48bc-adc4-6c97c4a035ae None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.253866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:29.257818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ba97-ee32-45ec-951b-e6c455724ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.258621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ba97-ee32-45ec-951b-e6c455724ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.258899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ba97-ee32-45ec-951b-e6c455724ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.259170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ba97-ee32-45ec-951b-e6c455724ba3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.271734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287ba97-ee32-45ec-951b-e6c455724ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-8287ba97-ee32-45ec-951b-e6c455724ba3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:29.281510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:29.282420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:29.283221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:29.283840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 202/406] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:29.284428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ba97-ee32-45ec-951b-e6c455724ba3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.316756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf882bc4-a973-4dc4-b081-7b7fda518e26 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.320818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:29.354395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e14f0-bb03-4aac-935e-3554b8b9b63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.355203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e14f0-bb03-4aac-935e-3554b8b9b63b None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.355488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e14f0-bb03-4aac-935e-3554b8b9b63b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.355797 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e14f0-bb03-4aac-935e-3554b8b9b63b None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c/groups/9959c4bd4bcc47a2b29d1095f7b5bebc/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.357792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e14f0-bb03-4aac-935e-3554b8b9b63b None admin] RBAC: Authorizing `identity:create_grant(project_id=edc11b80eb824c8391530bc7bb78d27c, group_id=9959c4bd4bcc47a2b29d1095f7b5bebc, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.359266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e14f0-bb03-4aac-935e-3554b8b9b63b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.406918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ba97-ee32-45ec-951b-e6c455724ba3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.447335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54673e02-aa22-41c0-a79d-3896e0089f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.448018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54673e02-aa22-41c0-a79d-3896e0089f79 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.448312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54673e02-aa22-41c0-a79d-3896e0089f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.448589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54673e02-aa22-41c0-a79d-3896e0089f79 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.449509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54673e02-aa22-41c0-a79d-3896e0089f79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:29.449815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54673e02-aa22-41c0-a79d-3896e0089f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.451250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54673e02-aa22-41c0-a79d-3896e0089f79 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.461537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 203/407] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:29.462525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54673e02-aa22-41c0-a79d-3896e0089f79 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.477561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 205/408] 10.222.0.74 () {58 vars in 1442 bytes} [Mon May 23 16:26:29 2022] PUT /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c/groups/9959c4bd4bcc47a2b29d1095f7b5bebc/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:29.480976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e14f0-bb03-4aac-935e-3554b8b9b63b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.650853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:29.666375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54673e02-aa22-41c0-a79d-3896e0089f79 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.693145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e14f0-bb03-4aac-935e-3554b8b9b63b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.699466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:29.731483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefe329-3d68-4909-b3cf-11f59ecf29bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.732317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefe329-3d68-4909-b3cf-11f59ecf29bd None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.732736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefe329-3d68-4909-b3cf-11f59ecf29bd None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.733074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefe329-3d68-4909-b3cf-11f59ecf29bd None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.733824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefe329-3d68-4909-b3cf-11f59ecf29bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:29.734127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefe329-3d68-4909-b3cf-11f59ecf29bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.735682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefe329-3d68-4909-b3cf-11f59ecf29bd None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.745889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 204/409] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:29.752167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefe329-3d68-4909-b3cf-11f59ecf29bd None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.757760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267fc4a-7499-48a5-8750-3e90f9c7599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.764681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267fc4a-7499-48a5-8750-3e90f9c7599c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.764681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267fc4a-7499-48a5-8750-3e90f9c7599c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.764681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267fc4a-7499-48a5-8750-3e90f9c7599c None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.764681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267fc4a-7499-48a5-8750-3e90f9c7599c None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.764681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267fc4a-7499-48a5-8750-3e90f9c7599c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.764681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 206/410] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:29.769854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267fc4a-7499-48a5-8750-3e90f9c7599c None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.880423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefe329-3d68-4909-b3cf-11f59ecf29bd None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.923567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99403ff9-7914-47f0-9b00-44065745dc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.924375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99403ff9-7914-47f0-9b00-44065745dc40 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.924660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99403ff9-7914-47f0-9b00-44065745dc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.924935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99403ff9-7914-47f0-9b00-44065745dc40 None admin] PATH_INFO: `/v3/groups/86757463e4dd48e6b56ec79f0093251d` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.927566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267fc4a-7499-48a5-8750-3e90f9c7599c None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.929768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99403ff9-7914-47f0-9b00-44065745dc40 None admin] RBAC: Authorizing `identity:get_group(group_id=86757463e4dd48e6b56ec79f0093251d)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.931218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99403ff9-7914-47f0-9b00-44065745dc40 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.933068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 205/411] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/groups/86757463e4dd48e6b56ec79f0093251d => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:29.941259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99403ff9-7914-47f0-9b00-44065745dc40 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.976515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a937-3c24-4647-8c5a-230f1258b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.977817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a937-3c24-4647-8c5a-230f1258b5eb None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.978147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a937-3c24-4647-8c5a-230f1258b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.978426 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a937-3c24-4647-8c5a-230f1258b5eb None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.979631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a937-3c24-4647-8c5a-230f1258b5eb None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.981147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a937-3c24-4647-8c5a-230f1258b5eb None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.983847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 207/412] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:29.990414 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a937-3c24-4647-8c5a-230f1258b5eb None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.991719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:30.071836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:30.157761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a937-3c24-4647-8c5a-230f1258b5eb None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:30.158216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99403ff9-7914-47f0-9b00-44065745dc40 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:30.204401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213618e6-0ba2-4382-83ad-3245532671c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:30.204401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213618e6-0ba2-4382-83ad-3245532671c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.204401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213618e6-0ba2-4382-83ad-3245532671c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.204401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213618e6-0ba2-4382-83ad-3245532671c2 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c/groups/9959c4bd4bcc47a2b29d1095f7b5bebc/roles/c07ef3c8c1574bb987c394026b04fb39` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.205140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213618e6-0ba2-4382-83ad-3245532671c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=edc11b80eb824c8391530bc7bb78d27c, group_id=9959c4bd4bcc47a2b29d1095f7b5bebc, role_id=c07ef3c8c1574bb987c394026b04fb39)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:30.205140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213618e6-0ba2-4382-83ad-3245532671c2 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:30.225110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be3a3d-0e86-4091-bac5-91ce295e7ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:30.226244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3a3d-0e86-4091-bac5-91ce295e7ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.226638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3a3d-0e86-4091-bac5-91ce295e7ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.226920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3a3d-0e86-4091-bac5-91ce295e7ec3 None admin] PATH_INFO: `/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.228144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3a3d-0e86-4091-bac5-91ce295e7ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=a06edcae6b7a4521b29d4cfac1cfa2c1)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:30.231465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3a3d-0e86-4091-bac5-91ce295e7ec3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:30.231792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 206/413] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1 => generated 344 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:30.240752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be3a3d-0e86-4091-bac5-91ce295e7ec3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:30.295237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 208/414] 10.222.0.74 () {58 vars in 1442 bytes} [Mon May 23 16:26:29 2022] PUT /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c/groups/9959c4bd4bcc47a2b29d1095f7b5bebc/roles/c07ef3c8c1574bb987c394026b04fb39 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:30.371590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:30.384945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be3a3d-0e86-4091-bac5-91ce295e7ec3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:30.435708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccbff1-896d-4559-9670-c5969d38579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:30.436635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccbff1-896d-4559-9670-c5969d38579a None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.436912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccbff1-896d-4559-9670-c5969d38579a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.437182 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccbff1-896d-4559-9670-c5969d38579a None admin] PATH_INFO: `/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1/groups/86757463e4dd48e6b56ec79f0093251d/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.439229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccbff1-896d-4559-9670-c5969d38579a None admin] RBAC: Authorizing `identity:create_grant(project_id=a06edcae6b7a4521b29d4cfac1cfa2c1, group_id=86757463e4dd48e6b56ec79f0093251d, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:30.440782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccbff1-896d-4559-9670-c5969d38579a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:30.527315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 207/415] 10.222.0.74 () {58 vars in 1442 bytes} [Mon May 23 16:26:30 2022] PUT /identity/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1/groups/86757463e4dd48e6b56ec79f0093251d/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:30.622530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9b5c5-2d96-4fa7-bfaa-69de357f76c3 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.623044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9b5c5-2d96-4fa7-bfaa-69de357f76c3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.623044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9b5c5-2d96-4fa7-bfaa-69de357f76c3 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.624838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 209/416] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:30.632112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37996216-17e4-46cc-91a6-0a4e5de1ae21 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.632481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37996216-17e4-46cc-91a6-0a4e5de1ae21 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.632708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37996216-17e4-46cc-91a6-0a4e5de1ae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.652838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-37996216-17e4-46cc-91a6-0a4e5de1ae21 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:30.654057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-37996216-17e4-46cc-91a6-0a4e5de1ae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:30.728465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ff78d-07f1-499c-bc41-c8c9d98a52ee None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.728465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ff78d-07f1-499c-bc41-c8c9d98a52ee None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.728465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ff78d-07f1-499c-bc41-c8c9d98a52ee None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.729903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 210/417] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:30.734193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 208/418] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:30.735937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee184716-09b0-49e0-87f8-22dccea5bfa2 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.736742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee184716-09b0-49e0-87f8-22dccea5bfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.737224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee184716-09b0-49e0-87f8-22dccea5bfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.755581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37996216-17e4-46cc-91a6-0a4e5de1ae21 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:30.768328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-ee184716-09b0-49e0-87f8-22dccea5bfa2 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:30.769846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ee184716-09b0-49e0-87f8-22dccea5bfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:30.843749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:30.853233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 211/419] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:30.865092 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37996216-17e4-46cc-91a6-0a4e5de1ae21 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:30.878520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee184716-09b0-49e0-87f8-22dccea5bfa2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:30.905040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498272b-7108-497b-b6d8-357b1a8fd028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:30.905841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498272b-7108-497b-b6d8-357b1a8fd028 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.906122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498272b-7108-497b-b6d8-357b1a8fd028 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.906388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498272b-7108-497b-b6d8-357b1a8fd028 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.916979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:30.920497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498272b-7108-497b-b6d8-357b1a8fd028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-8498272b-7108-497b-b6d8-357b1a8fd028 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:30.928456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:30.930088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:30.930867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:30.935121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 209/420] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:30.936504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498272b-7108-497b-b6d8-357b1a8fd028 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:30.994152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee184716-09b0-49e0-87f8-22dccea5bfa2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:31.032756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea789ade-92c9-4b9c-9ca1-af97010bca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:31.033657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea789ade-92c9-4b9c-9ca1-af97010bca8f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:31.033941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea789ade-92c9-4b9c-9ca1-af97010bca8f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:31.034217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea789ade-92c9-4b9c-9ca1-af97010bca8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:31.046297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea789ade-92c9-4b9c-9ca1-af97010bca8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:31.050461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498272b-7108-497b-b6d8-357b1a8fd028 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-ea789ade-92c9-4b9c-9ca1-af97010bca8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:31.055832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:31.057847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:31.058842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 212/421] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:26:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:31.066097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea789ade-92c9-4b9c-9ca1-af97010bca8f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:31.087834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bae35-8834-4c16-9343-1bbc1497d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:31.088537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bae35-8834-4c16-9343-1bbc1497d149 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:31.088818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bae35-8834-4c16-9343-1bbc1497d149 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:31.089098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bae35-8834-4c16-9343-1bbc1497d149 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:31.089849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bae35-8834-4c16-9343-1bbc1497d149 None admin] RBAC: Adding query filter params (name=member) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:31.090149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bae35-8834-4c16-9343-1bbc1497d149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:31.091540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bae35-8834-4c16-9343-1bbc1497d149 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:31.105208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 210/422] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:31.107203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bae35-8834-4c16-9343-1bbc1497d149 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:31.109995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:31.216509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bae35-8834-4c16-9343-1bbc1497d149 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:31.253361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ad8e3-d351-4415-a3b3-8d232278462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:31.254013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ad8e3-d351-4415-a3b3-8d232278462b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:31.254293 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ad8e3-d351-4415-a3b3-8d232278462b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:31.254564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ad8e3-d351-4415-a3b3-8d232278462b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:31.270986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:31.296006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea789ade-92c9-4b9c-9ca1-af97010bca8f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:31.331204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ad8e3-d351-4415-a3b3-8d232278462b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:31.332809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ad8e3-d351-4415-a3b3-8d232278462b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:31.334632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:31.362288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687bc8-7fb0-4378-a86a-6fb4ec5f8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:31.362901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687bc8-7fb0-4378-a86a-6fb4ec5f8425 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:31.363188 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687bc8-7fb0-4378-a86a-6fb4ec5f8425 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:31.363471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687bc8-7fb0-4378-a86a-6fb4ec5f8425 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:31.364230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b687bc8-7fb0-4378-a86a-6fb4ec5f8425 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:31.364568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b687bc8-7fb0-4378-a86a-6fb4ec5f8425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:31.366004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b687bc8-7fb0-4378-a86a-6fb4ec5f8425 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:31.383925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 213/423] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:31.389053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687bc8-7fb0-4378-a86a-6fb4ec5f8425 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:31.461431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 211/424] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:31.465581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ad8e3-d351-4415-a3b3-8d232278462b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:31.521386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687bc8-7fb0-4378-a86a-6fb4ec5f8425 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:31.609171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb0c83-6dbe-44f4-8862-405aa6f27fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:31.609843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb0c83-6dbe-44f4-8862-405aa6f27fbe None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:31.610126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb0c83-6dbe-44f4-8862-405aa6f27fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:31.610401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb0c83-6dbe-44f4-8862-405aa6f27fbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:31.618646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ad8e3-d351-4415-a3b3-8d232278462b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:31.626284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:31.649409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:31.666510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa622396-ca40-4088-b8ea-fb552c7932bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:31.667373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa622396-ca40-4088-b8ea-fb552c7932bd None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:31.667677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa622396-ca40-4088-b8ea-fb552c7932bd None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:31.667953 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa622396-ca40-4088-b8ea-fb552c7932bd None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:31.673101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa622396-ca40-4088-b8ea-fb552c7932bd None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:31.674514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa622396-ca40-4088-b8ea-fb552c7932bd None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:31.681336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 212/425] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:31 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:31.687120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa622396-ca40-4088-b8ea-fb552c7932bd None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:31.736169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb0c83-6dbe-44f4-8862-405aa6f27fbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:31.740066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb0c83-6dbe-44f4-8862-405aa6f27fbe None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:31.885623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa622396-ca40-4088-b8ea-fb552c7932bd None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:31.939263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37b17c-3878-4614-bda2-89f7356ab3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:31.940383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37b17c-3878-4614-bda2-89f7356ab3dd None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:31.940807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37b17c-3878-4614-bda2-89f7356ab3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:31.941269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37b17c-3878-4614-bda2-89f7356ab3dd None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:31.942608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37b17c-3878-4614-bda2-89f7356ab3dd None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:31.944802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37b17c-3878-4614-bda2-89f7356ab3dd None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:31.946981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 213/426] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:31 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:31.952353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37b17c-3878-4614-bda2-89f7356ab3dd None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:31.964774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 214/427] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:31.965933 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb0c83-6dbe-44f4-8862-405aa6f27fbe None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:32.024635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:32.080712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:32.135510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37b17c-3878-4614-bda2-89f7356ab3dd None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:32.158576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb0c83-6dbe-44f4-8862-405aa6f27fbe None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:32.204591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bb94c-4b8b-4448-bfcf-9096d9a4b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:32.205255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bb94c-4b8b-4448-bfcf-9096d9a4b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.205539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bb94c-4b8b-4448-bfcf-9096d9a4b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.205816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bb94c-4b8b-4448-bfcf-9096d9a4b9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.206653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bb94c-4b8b-4448-bfcf-9096d9a4b9f4 None admin] RBAC: Adding query filter params (group.id=9959c4bd4bcc47a2b29d1095f7b5bebc, role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=07ec6eba37f64872812e5e3802a57be0) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:32.206967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bb94c-4b8b-4448-bfcf-9096d9a4b9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:32.208444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bb94c-4b8b-4448-bfcf-9096d9a4b9f4 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:32.222248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 214/428] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:31 2022] GET /identity/v3/role_assignments?group.id=9959c4bd4bcc47a2b29d1095f7b5bebc&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 611 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:32.224195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be49e15-13e2-4c3b-8759-16bede3927ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:32.225099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49e15-13e2-4c3b-8759-16bede3927ea None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.225475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49e15-13e2-4c3b-8759-16bede3927ea None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.225851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49e15-13e2-4c3b-8759-16bede3927ea None admin] PATH_INFO: `/v3/projects/07ec6eba37f64872812e5e3802a57be0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.227217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be49e15-13e2-4c3b-8759-16bede3927ea None admin] RBAC: Authorizing `identity:get_project(project_id=07ec6eba37f64872812e5e3802a57be0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:32.228743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be49e15-13e2-4c3b-8759-16bede3927ea None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:32.230844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 215/429] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:31 2022] GET /identity/v3/projects/07ec6eba37f64872812e5e3802a57be0 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:32.236478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bb94c-4b8b-4448-bfcf-9096d9a4b9f4 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:32.301129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55b02-ebd9-49da-8a03-2dd7ac09e100 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.301596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55b02-ebd9-49da-8a03-2dd7ac09e100 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.301766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55b02-ebd9-49da-8a03-2dd7ac09e100 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.303759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 216/430] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:26:32.308845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bb58d-5896-4474-8947-983071eedf51 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.309131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bb58d-5896-4474-8947-983071eedf51 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.309412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bb58d-5896-4474-8947-983071eedf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.327380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b48bb58d-5896-4474-8947-983071eedf51 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:32.328609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b48bb58d-5896-4474-8947-983071eedf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:32.392618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bb94c-4b8b-4448-bfcf-9096d9a4b9f4 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:32.394663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:32.432988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d739335-f6e0-4582-84fa-45c72eafbcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:32.433794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d739335-f6e0-4582-84fa-45c72eafbcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.434082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d739335-f6e0-4582-84fa-45c72eafbcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.434361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d739335-f6e0-4582-84fa-45c72eafbcd3 None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.435600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d739335-f6e0-4582-84fa-45c72eafbcd3 None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:32.437109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d739335-f6e0-4582-84fa-45c72eafbcd3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:32.439220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 215/431] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:32 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:32.441788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 217/432] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:32.445884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d739335-f6e0-4582-84fa-45c72eafbcd3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:32.475145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bb58d-5896-4474-8947-983071eedf51 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:32.540667 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:32.570376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d739335-f6e0-4582-84fa-45c72eafbcd3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:32.596785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bb58d-5896-4474-8947-983071eedf51 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:32.610080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e33bc-a9ba-48b4-9ddd-eb6e49cb2e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:32.610737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e33bc-a9ba-48b4-9ddd-eb6e49cb2e2b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.611018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e33bc-a9ba-48b4-9ddd-eb6e49cb2e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.611294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e33bc-a9ba-48b4-9ddd-eb6e49cb2e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.612134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e33bc-a9ba-48b4-9ddd-eb6e49cb2e2b None admin] RBAC: Adding query filter params (group.id=9959c4bd4bcc47a2b29d1095f7b5bebc, role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=07ec6eba37f64872812e5e3802a57be0) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:32.612545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e33bc-a9ba-48b4-9ddd-eb6e49cb2e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:32.613985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e33bc-a9ba-48b4-9ddd-eb6e49cb2e2b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:32.621362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 216/433] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:32 2022] GET /identity/v3/role_assignments?group.id=9959c4bd4bcc47a2b29d1095f7b5bebc&scope.project.id=07ec6eba37f64872812e5e3802a57be0&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:32.652009 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbedc-e558-4a1f-b866-650c837e8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:32.652884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbedc-e558-4a1f-b866-650c837e8c66 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.653174 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbedc-e558-4a1f-b866-650c837e8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.653455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbedc-e558-4a1f-b866-650c837e8c66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.668999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbbedc-e558-4a1f-b866-650c837e8c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-89fbbedc-e558-4a1f-b866-650c837e8c66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:32.676950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:32.679880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:32.681892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 218/434] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:32.686342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e33bc-a9ba-48b4-9ddd-eb6e49cb2e2b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:32.741162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:32.833550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e33bc-a9ba-48b4-9ddd-eb6e49cb2e2b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:32.876653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa3edc-d93f-4322-a9e4-14331dbf1979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:32.877330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa3edc-d93f-4322-a9e4-14331dbf1979 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.877621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa3edc-d93f-4322-a9e4-14331dbf1979 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.877870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa3edc-d93f-4322-a9e4-14331dbf1979 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.878618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa3edc-d93f-4322-a9e4-14331dbf1979 None admin] RBAC: Adding query filter params (name=member) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:32.878919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa3edc-d93f-4322-a9e4-14331dbf1979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:32.880327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa3edc-d93f-4322-a9e4-14331dbf1979 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:32.890135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 217/435] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:32.895611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbedc-e558-4a1f-b866-650c837e8c66 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.020821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbedc-e558-4a1f-b866-650c837e8c66 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.032565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.056715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61647c-8cc5-4346-b64a-e344e98e241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.057371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61647c-8cc5-4346-b64a-e344e98e241d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.057650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61647c-8cc5-4346-b64a-e344e98e241d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.057922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61647c-8cc5-4346-b64a-e344e98e241d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.135898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61647c-8cc5-4346-b64a-e344e98e241d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:33.137584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61647c-8cc5-4346-b64a-e344e98e241d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:33.161193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e7639-34bb-4d93-9519-ef6ffb4cd7e2 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.161945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e7639-34bb-4d93-9519-ef6ffb4cd7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.162230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e7639-34bb-4d93-9519-ef6ffb4cd7e2 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.164542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 218/436] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:26:33.171204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fa76b-edcd-4f6d-956e-853766387a33 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.171492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fa76b-edcd-4f6d-956e-853766387a33 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.171772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fa76b-edcd-4f6d-956e-853766387a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.191720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-480fa76b-edcd-4f6d-956e-853766387a33 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:33.192981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-480fa76b-edcd-4f6d-956e-853766387a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:33.276994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 219/437] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:33.282183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61647c-8cc5-4346-b64a-e344e98e241d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.284807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 219/438] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:33.293266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d13c6f-edda-47e4-b574-96fd3a71e9d6 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.293555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d13c6f-edda-47e4-b574-96fd3a71e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.293843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d13c6f-edda-47e4-b574-96fd3a71e9d6 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.294044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.295334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 220/439] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:26:33.300102 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3651cca-557e-48d0-bce1-e4a1a803940e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.300514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3651cca-557e-48d0-bce1-e4a1a803940e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.300779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3651cca-557e-48d0-bce1-e4a1a803940e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.317972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c3651cca-557e-48d0-bce1-e4a1a803940e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:33.319677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c3651cca-557e-48d0-bce1-e4a1a803940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:33.340520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.382055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61647c-8cc5-4346-b64a-e344e98e241d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.386071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 221/440] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:33.386900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3651cca-557e-48d0-bce1-e4a1a803940e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.423104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478ef4f-21c3-4161-a545-47b87496e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.423969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ef4f-21c3-4161-a545-47b87496e951 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.424253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ef4f-21c3-4161-a545-47b87496e951 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.424560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ef4f-21c3-4161-a545-47b87496e951 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.425752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478ef4f-21c3-4161-a545-47b87496e951 None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:33.427211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478ef4f-21c3-4161-a545-47b87496e951 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:33.429219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 220/441] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:33.429989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478ef4f-21c3-4161-a545-47b87496e951 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.485684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3651cca-557e-48d0-bce1-e4a1a803940e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.507902 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.519867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd58da-aca0-4823-b176-b60b920b7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.520702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd58da-aca0-4823-b176-b60b920b7890 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.520986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd58da-aca0-4823-b176-b60b920b7890 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.521261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd58da-aca0-4823-b176-b60b920b7890 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.530259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478ef4f-21c3-4161-a545-47b87496e951 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.532333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd58da-aca0-4823-b176-b60b920b7890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-6ddd58da-aca0-4823-b176-b60b920b7890 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:33.541109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:33.541983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 222/442] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:33.547533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd58da-aca0-4823-b176-b60b920b7890 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.560995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.572202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac15b3-c97e-4372-bc59-ae0ad965e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.573028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac15b3-c97e-4372-bc59-ae0ad965e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.573313 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac15b3-c97e-4372-bc59-ae0ad965e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.573591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac15b3-c97e-4372-bc59-ae0ad965e1a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.583950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac15b3-c97e-4372-bc59-ae0ad965e1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-e2ac15b3-c97e-4372-bc59-ae0ad965e1a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:33.592239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:33.593328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:33.594125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 221/443] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:33.594772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac15b3-c97e-4372-bc59-ae0ad965e1a2 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.645276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd58da-aca0-4823-b176-b60b920b7890 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.680016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066a7ea-086f-480d-927c-5c7aa6addc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.680897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a7ea-086f-480d-927c-5c7aa6addc35 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.681179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a7ea-086f-480d-927c-5c7aa6addc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.681453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a7ea-086f-480d-927c-5c7aa6addc35 None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.682640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066a7ea-086f-480d-927c-5c7aa6addc35 None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:33.684089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066a7ea-086f-480d-927c-5c7aa6addc35 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:33.685752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 223/444] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:33.686506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066a7ea-086f-480d-927c-5c7aa6addc35 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.699721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac15b3-c97e-4372-bc59-ae0ad965e1a2 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.732852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf842906-e304-46e6-bcd6-43fc50013bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.733519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf842906-e304-46e6-bcd6-43fc50013bcc None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.733803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf842906-e304-46e6-bcd6-43fc50013bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.734081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf842906-e304-46e6-bcd6-43fc50013bcc None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.734833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf842906-e304-46e6-bcd6-43fc50013bcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:33.735141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf842906-e304-46e6-bcd6-43fc50013bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:33.736598 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf842906-e304-46e6-bcd6-43fc50013bcc None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:33.741994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.745753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 222/445] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:33.746530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf842906-e304-46e6-bcd6-43fc50013bcc None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.770974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.786065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066a7ea-086f-480d-927c-5c7aa6addc35 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.818870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46944598-dd98-49cd-9be4-40cc69bfed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.820087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46944598-dd98-49cd-9be4-40cc69bfed7c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.820402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46944598-dd98-49cd-9be4-40cc69bfed7c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.820672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46944598-dd98-49cd-9be4-40cc69bfed7c None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.821406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46944598-dd98-49cd-9be4-40cc69bfed7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:33.821705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46944598-dd98-49cd-9be4-40cc69bfed7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:33.823068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46944598-dd98-49cd-9be4-40cc69bfed7c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:33.830977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 224/446] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:33.831755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46944598-dd98-49cd-9be4-40cc69bfed7c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.846322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf842906-e304-46e6-bcd6-43fc50013bcc None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.879718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff34117-7aca-44db-82da-37fd5c295b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.880397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff34117-7aca-44db-82da-37fd5c295b56 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.880680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff34117-7aca-44db-82da-37fd5c295b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.880960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff34117-7aca-44db-82da-37fd5c295b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.882399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff34117-7aca-44db-82da-37fd5c295b56 None admin] RBAC: Adding query filter params (group.id=9959c4bd4bcc47a2b29d1095f7b5bebc, role.id=6b4e2fa093c2483a91793d5ad27bc6e8, scope.project.id=edc11b80eb824c8391530bc7bb78d27c) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:33.882716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff34117-7aca-44db-82da-37fd5c295b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:33.884147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff34117-7aca-44db-82da-37fd5c295b56 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:33.890793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 223/447] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/role_assignments?group.id=9959c4bd4bcc47a2b29d1095f7b5bebc&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=6b4e2fa093c2483a91793d5ad27bc6e8 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:33.891634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff34117-7aca-44db-82da-37fd5c295b56 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.939235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46944598-dd98-49cd-9be4-40cc69bfed7c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.965545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.986002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8adf42-88ba-404f-9615-75e66347088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.986667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8adf42-88ba-404f-9615-75e66347088c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.986948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8adf42-88ba-404f-9615-75e66347088c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.987220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8adf42-88ba-404f-9615-75e66347088c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:34.005526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:34.012678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff34117-7aca-44db-82da-37fd5c295b56 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:34.052210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ab998-cefd-408f-94b8-b95a5031fa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:34.052817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ab998-cefd-408f-94b8-b95a5031fa9d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:34.053219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ab998-cefd-408f-94b8-b95a5031fa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:34.053516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ab998-cefd-408f-94b8-b95a5031fa9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:34.068550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8adf42-88ba-404f-9615-75e66347088c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:34.070763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8adf42-88ba-404f-9615-75e66347088c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.128760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ab998-cefd-408f-94b8-b95a5031fa9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:34.130212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ab998-cefd-408f-94b8-b95a5031fa9d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.197876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 225/448] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:34.204016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8adf42-88ba-404f-9615-75e66347088c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:34.208707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:34.256060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 224/449] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:34.261659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ab998-cefd-408f-94b8-b95a5031fa9d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:34.267367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:34.324398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8adf42-88ba-404f-9615-75e66347088c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:34.360062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7cbe3-6d07-48ab-b82b-579186c8fc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:34.360942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7cbe3-6d07-48ab-b82b-579186c8fc44 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:34.361222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7cbe3-6d07-48ab-b82b-579186c8fc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:34.361495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7cbe3-6d07-48ab-b82b-579186c8fc44 None admin] PATH_INFO: `/v3/projects/edc11b80eb824c8391530bc7bb78d27c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:34.362635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7cbe3-6d07-48ab-b82b-579186c8fc44 None admin] RBAC: Authorizing `identity:get_project(project_id=edc11b80eb824c8391530bc7bb78d27c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:34.364073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7cbe3-6d07-48ab-b82b-579186c8fc44 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.365773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 226/450] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:34 2022] GET /identity/v3/projects/edc11b80eb824c8391530bc7bb78d27c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:34.367055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ab998-cefd-408f-94b8-b95a5031fa9d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:34.371162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7cbe3-6d07-48ab-b82b-579186c8fc44 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:34.402118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea88e-8184-4f03-bf56-cba47ac1fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:34.402975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea88e-8184-4f03-bf56-cba47ac1fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:34.403257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea88e-8184-4f03-bf56-cba47ac1fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:34.403537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea88e-8184-4f03-bf56-cba47ac1fcd4 None admin] PATH_INFO: `/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:34.404738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ea88e-8184-4f03-bf56-cba47ac1fcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=a06edcae6b7a4521b29d4cfac1cfa2c1)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:34.406215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ea88e-8184-4f03-bf56-cba47ac1fcd4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.407882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 225/451] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:26:34 2022] GET /identity/v3/projects/a06edcae6b7a4521b29d4cfac1cfa2c1 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:34.413914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea88e-8184-4f03-bf56-cba47ac1fcd4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:34.443730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:34.468156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7cbe3-6d07-48ab-b82b-579186c8fc44 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:34.482522 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:34.502207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f075e-222c-4664-972b-28e1b42a4cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:34.503065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f075e-222c-4664-972b-28e1b42a4cfc None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:34.503352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f075e-222c-4664-972b-28e1b42a4cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:34.503628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f075e-222c-4664-972b-28e1b42a4cfc None admin] PATH_INFO: `/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:34.504826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f075e-222c-4664-972b-28e1b42a4cfc None admin] RBAC: Authorizing `identity:get_group(group_id=9959c4bd4bcc47a2b29d1095f7b5bebc)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:34.506511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f075e-222c-4664-972b-28e1b42a4cfc None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.508596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 227/452] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:34 2022] GET /identity/v3/groups/9959c4bd4bcc47a2b29d1095f7b5bebc => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:34.514246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f075e-222c-4664-972b-28e1b42a4cfc None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:34.515227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea88e-8184-4f03-bf56-cba47ac1fcd4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:34.551267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad18168-6283-4368-b4e8-c362e854240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:34.552116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad18168-6283-4368-b4e8-c362e854240f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:34.552434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad18168-6283-4368-b4e8-c362e854240f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:34.552715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad18168-6283-4368-b4e8-c362e854240f None admin] PATH_INFO: `/v3/groups/86757463e4dd48e6b56ec79f0093251d` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:34.554175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad18168-6283-4368-b4e8-c362e854240f None admin] RBAC: Authorizing `identity:get_group(group_id=86757463e4dd48e6b56ec79f0093251d)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:34.555632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad18168-6283-4368-b4e8-c362e854240f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.557292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 226/453] 10.222.0.74 () {56 vars in 1180 bytes} [Mon May 23 16:26:34 2022] GET /identity/v3/groups/86757463e4dd48e6b56ec79f0093251d => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:34.562898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad18168-6283-4368-b4e8-c362e854240f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:34.612962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f075e-222c-4664-972b-28e1b42a4cfc None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:34.646965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfb233-950d-41ea-8dcd-c56c9128e940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:34.648432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfb233-950d-41ea-8dcd-c56c9128e940 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:34.648724 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfb233-950d-41ea-8dcd-c56c9128e940 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:34.648999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfb233-950d-41ea-8dcd-c56c9128e940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:34.649831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfb233-950d-41ea-8dcd-c56c9128e940 None admin] RBAC: Adding query filter params (group.id=9959c4bd4bcc47a2b29d1095f7b5bebc, role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=edc11b80eb824c8391530bc7bb78d27c) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:34.650142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfb233-950d-41ea-8dcd-c56c9128e940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:34.651576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfb233-950d-41ea-8dcd-c56c9128e940 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.657552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:34.657988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 228/454] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:34 2022] GET /identity/v3/role_assignments?group.id=9959c4bd4bcc47a2b29d1095f7b5bebc&scope.project.id=edc11b80eb824c8391530bc7bb78d27c&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:34.667345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad18168-6283-4368-b4e8-c362e854240f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:34.704230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8168b-519a-439e-9a03-41501a021d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:34.704953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8168b-519a-439e-9a03-41501a021d28 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:34.705186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8168b-519a-439e-9a03-41501a021d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:34.705461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8168b-519a-439e-9a03-41501a021d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:34.706367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8168b-519a-439e-9a03-41501a021d28 None admin] RBAC: Adding query filter params (group.id=86757463e4dd48e6b56ec79f0093251d, role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=a06edcae6b7a4521b29d4cfac1cfa2c1) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:34.706683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8168b-519a-439e-9a03-41501a021d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:34.708151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8168b-519a-439e-9a03-41501a021d28 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.714873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 227/455] 10.222.0.74 () {56 vars in 1376 bytes} [Mon May 23 16:26:34 2022] GET /identity/v3/role_assignments?group.id=86757463e4dd48e6b56ec79f0093251d&scope.project.id=a06edcae6b7a4521b29d4cfac1cfa2c1&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:37.785249 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4bea-1e4c-41f6-968a-6c2763559baa None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:37.785775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4bea-1e4c-41f6-968a-6c2763559baa None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:37.785928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4bea-1e4c-41f6-968a-6c2763559baa None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:37.788419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 229/456] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:37.793459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d393856-f8dd-47c2-af1e-01d764f32de4 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:37.794248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d393856-f8dd-47c2-af1e-01d764f32de4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:37.794674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d393856-f8dd-47c2-af1e-01d764f32de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:37.821438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9d393856-f8dd-47c2-af1e-01d764f32de4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:37.822932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9d393856-f8dd-47c2-af1e-01d764f32de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:37.910946 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 228/457] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:37.947539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f4bea-1e4c-41f6-968a-6c2763559baa None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:37.950352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893cd2-38ee-41db-bd63-92cb526d7c40 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:37.950807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893cd2-38ee-41db-bd63-92cb526d7c40 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:37.951230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893cd2-38ee-41db-bd63-92cb526d7c40 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:37.953024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 229/458] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:37.958196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095e72-e2fe-4690-bdd6-535811c60927 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:37.958649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095e72-e2fe-4690-bdd6-535811c60927 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:37.959073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095e72-e2fe-4690-bdd6-535811c60927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:37.987086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4b095e72-e2fe-4690-bdd6-535811c60927 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:37.988308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4b095e72-e2fe-4690-bdd6-535811c60927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:38.023665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:38.073914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f4bea-1e4c-41f6-968a-6c2763559baa None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.075479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 230/459] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 16:26:38.077157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90c07b-26cd-47a9-820b-c963d72c23a4 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.077595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90c07b-26cd-47a9-820b-c963d72c23a4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.078021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90c07b-26cd-47a9-820b-c963d72c23a4 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.079702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 231/460] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:38.086978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037a60f-1651-45aa-afc0-8aaa6ca76ddd None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.087443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037a60f-1651-45aa-afc0-8aaa6ca76ddd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.087870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037a60f-1651-45aa-afc0-8aaa6ca76ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.106369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4037a60f-1651-45aa-afc0-8aaa6ca76ddd None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:38.107811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4037a60f-1651-45aa-afc0-8aaa6ca76ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:38.131145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:38.133956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196ff6-5750-4bfa-9ce9-f7c557dade11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.135034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196ff6-5750-4bfa-9ce9-f7c557dade11 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.135460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196ff6-5750-4bfa-9ce9-f7c557dade11 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.135875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196ff6-5750-4bfa-9ce9-f7c557dade11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.147607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a196ff6-5750-4bfa-9ce9-f7c557dade11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.149326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a196ff6-5750-4bfa-9ce9-f7c557dade11 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-0a196ff6-5750-4bfa-9ce9-f7c557dade11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:38.179481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:38.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:38.181342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:38.181342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:38.181342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:38.181342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:38.181342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 230/461] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:38.182162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196ff6-5750-4bfa-9ce9-f7c557dade11 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.202288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 232/462] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:38.203592 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037a60f-1651-45aa-afc0-8aaa6ca76ddd None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.312856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:38.317789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196ff6-5750-4bfa-9ce9-f7c557dade11 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.350555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037a60f-1651-45aa-afc0-8aaa6ca76ddd None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.355340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fec5b-0268-4516-8ff4-6bcc577df198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.356462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fec5b-0268-4516-8ff4-6bcc577df198 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.356950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fec5b-0268-4516-8ff4-6bcc577df198 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.357454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fec5b-0268-4516-8ff4-6bcc577df198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.369667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fec5b-0268-4516-8ff4-6bcc577df198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.371874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fec5b-0268-4516-8ff4-6bcc577df198 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:38.388640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a780b2e-cff0-4e20-99ff-0ae0933e50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.389306 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780b2e-cff0-4e20-99ff-0ae0933e50e1 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.389589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780b2e-cff0-4e20-99ff-0ae0933e50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.389866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780b2e-cff0-4e20-99ff-0ae0933e50e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.390593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a780b2e-cff0-4e20-99ff-0ae0933e50e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:38.390899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a780b2e-cff0-4e20-99ff-0ae0933e50e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-f00fec5b-0268-4516-8ff4-6bcc577df198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:38.391968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:38.393163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:38.394229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:38.394229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:38.394229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:38.394229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:38.394508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a780b2e-cff0-4e20-99ff-0ae0933e50e1 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:38.395864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 231/463] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:38.396878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fec5b-0268-4516-8ff4-6bcc577df198 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.415063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 233/464] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:38.416626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f55c9e-396f-46ef-a931-f9e59b739edb None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.416925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f55c9e-396f-46ef-a931-f9e59b739edb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.417363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f55c9e-396f-46ef-a931-f9e59b739edb None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.418741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 234/465] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:38.419297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f55c9e-396f-46ef-a931-f9e59b739edb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.435610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:38.514417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fec5b-0268-4516-8ff4-6bcc577df198 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.522895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f55c9e-396f-46ef-a931-f9e59b739edb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.554097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f6ccb-d5bc-41eb-95f0-9a7046025200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.554895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f6ccb-d5bc-41eb-95f0-9a7046025200 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.555183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f6ccb-d5bc-41eb-95f0-9a7046025200 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.555485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f6ccb-d5bc-41eb-95f0-9a7046025200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.563913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157075-c555-40b2-be6c-6945ba9460c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.564978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157075-c555-40b2-be6c-6945ba9460c3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.565417 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157075-c555-40b2-be6c-6945ba9460c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.565704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157075-c555-40b2-be6c-6945ba9460c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.566432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157075-c555-40b2-be6c-6945ba9460c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:38.566649 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f6ccb-d5bc-41eb-95f0-9a7046025200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.566746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157075-c555-40b2-be6c-6945ba9460c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.568105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157075-c555-40b2-be6c-6945ba9460c3 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:38.568577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f6ccb-d5bc-41eb-95f0-9a7046025200 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:38.581364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 235/466] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:38.582168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157075-c555-40b2-be6c-6945ba9460c3 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-6c4f6ccb-d5bc-41eb-95f0-9a7046025200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:38.595065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:38.595934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:38.596805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:38.596805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:38.596805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:38.596805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:38.596805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 232/467] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:38.598672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fd248-c48e-40d4-8e97-06f6708d1030 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.598918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fd248-c48e-40d4-8e97-06f6708d1030 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.599208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fd248-c48e-40d4-8e97-06f6708d1030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.604637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:38.618185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-989fd248-c48e-40d4-8e97-06f6708d1030 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:38.637578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-989fd248-c48e-40d4-8e97-06f6708d1030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:38.673406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:38.696555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157075-c555-40b2-be6c-6945ba9460c3 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.700486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 233/468] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:38.700486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fd248-c48e-40d4-8e97-06f6708d1030 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.736124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594b831-3ffc-46f7-a4dd-c8075a7ebe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.736831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594b831-3ffc-46f7-a4dd-c8075a7ebe0a None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.737117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594b831-3ffc-46f7-a4dd-c8075a7ebe0a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.737396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594b831-3ffc-46f7-a4dd-c8075a7ebe0a None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.738098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594b831-3ffc-46f7-a4dd-c8075a7ebe0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.739531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594b831-3ffc-46f7-a4dd-c8075a7ebe0a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:38.810653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fd248-c48e-40d4-8e97-06f6708d1030 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.834872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 236/469] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:26:38 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:38.835717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594b831-3ffc-46f7-a4dd-c8075a7ebe0a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.841446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:38.849543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ec4ac-1411-41a4-98bc-b996bb52bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.850360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec4ac-1411-41a4-98bc-b996bb52bce4 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.850636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec4ac-1411-41a4-98bc-b996bb52bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.850907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec4ac-1411-41a4-98bc-b996bb52bce4 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.851998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ec4ac-1411-41a4-98bc-b996bb52bce4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.853585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ec4ac-1411-41a4-98bc-b996bb52bce4 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:38.947429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594b831-3ffc-46f7-a4dd-c8075a7ebe0a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.956601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 234/470] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:26:38 2022] POST /identity/v3/users => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:38.956601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ec4ac-1411-41a4-98bc-b996bb52bce4 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.983780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:38.990155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a53dc-8f0c-46e1-82a2-e66ec73f5541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.991421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a53dc-8f0c-46e1-82a2-e66ec73f5541 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.991929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a53dc-8f0c-46e1-82a2-e66ec73f5541 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.992368 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a53dc-8f0c-46e1-82a2-e66ec73f5541 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.993237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a53dc-8f0c-46e1-82a2-e66ec73f5541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:38.993552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a53dc-8f0c-46e1-82a2-e66ec73f5541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.995101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a53dc-8f0c-46e1-82a2-e66ec73f5541 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:39.010783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 237/471] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:39.012339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19a78-9076-4727-ac35-ba1a781ca3c6 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.012762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19a78-9076-4727-ac35-ba1a781ca3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.013055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19a78-9076-4727-ac35-ba1a781ca3c6 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.014757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 238/472] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:39.015886 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed19a78-9076-4727-ac35-ba1a781ca3c6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.102380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ec4ac-1411-41a4-98bc-b996bb52bce4 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.143407 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc64410-a9b0-4e7d-98d6-77a12ab51054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.144370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc64410-a9b0-4e7d-98d6-77a12ab51054 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.144703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc64410-a9b0-4e7d-98d6-77a12ab51054 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.145061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc64410-a9b0-4e7d-98d6-77a12ab51054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.157559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed19a78-9076-4727-ac35-ba1a781ca3c6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.158177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc64410-a9b0-4e7d-98d6-77a12ab51054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:39.159734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc64410-a9b0-4e7d-98d6-77a12ab51054 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-fbc64410-a9b0-4e7d-98d6-77a12ab51054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:39.182129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:39.183017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:39.183882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:39.183882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:39.183882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:39.183882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:39.183882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 235/473] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:39.185083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc09e1-2290-474b-bfd5-fd96438eb831 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.188329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc09e1-2290-474b-bfd5-fd96438eb831 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.188329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc09e1-2290-474b-bfd5-fd96438eb831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.204689 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-26fc09e1-2290-474b-bfd5-fd96438eb831 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:39.205823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-26fc09e1-2290-474b-bfd5-fd96438eb831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:39.216211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fc777-13de-40e6-aed3-1c56b299046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.216525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fc777-13de-40e6-aed3-1c56b299046b None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.216812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fc777-13de-40e6-aed3-1c56b299046b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.217092 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fc777-13de-40e6-aed3-1c56b299046b None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.217822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fc777-13de-40e6-aed3-1c56b299046b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:39.219911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fc777-13de-40e6-aed3-1c56b299046b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:39.253392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:39.288316 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 236/474] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:39.289263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc09e1-2290-474b-bfd5-fd96438eb831 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.343615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 239/475] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:26:39 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:39.344653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fc777-13de-40e6-aed3-1c56b299046b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.452488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:39.465585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc09e1-2290-474b-bfd5-fd96438eb831 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.539448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c4325-434a-4798-b7a9-3391b2554927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.540122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c4325-434a-4798-b7a9-3391b2554927 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.540442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c4325-434a-4798-b7a9-3391b2554927 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.540718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c4325-434a-4798-b7a9-3391b2554927 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.541455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c4325-434a-4798-b7a9-3391b2554927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:39.541763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c4325-434a-4798-b7a9-3391b2554927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:39.544456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c4325-434a-4798-b7a9-3391b2554927 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:39.549971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fc777-13de-40e6-aed3-1c56b299046b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.557298 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 237/476] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:39.565887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c4325-434a-4798-b7a9-3391b2554927 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.588330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.589303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.589763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.590241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.591157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:39.592771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:39.602555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:39.622463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.sql.core [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 16:26:39.622463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 16:26:39.622463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [parameters: {'id': '8c49c3025b54455f9726387b0824950e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 16:26:39.622463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80676) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application conn.query(q) May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application result.read() May 23 16:26:39.639841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return ref.to_dict() May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:26:39.640889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application next(self.gen) May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application yield resource May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application next(self.gen) May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self.session.rollback() May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self.force_reraise() May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise self.value May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application session.commit() May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 16:26:39.641815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._prepare_impl() May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self.session.flush() May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._flush(objects) May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application compat.raise_( May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application flush_context.execute() May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rec.execute(self) May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 16:26:39.643556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:26:39.644479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application conn.query(q) May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application result.read() May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:26:39.645900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [parameters: {'id': '8c49c3025b54455f9726387b0824950e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:39.648937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 16:26:39.652539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:39.654861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 240/477] 10.222.0.74 () {60 vars in 1131 bytes} [Mon May 23 16:26:39 2022] POST /identity/v3/roles => generated 144 bytes in 297 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:39.654861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.709046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c4325-434a-4798-b7a9-3391b2554927 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.757186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae02158-fcec-4bc0-9114-d447eefc0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.758277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae02158-fcec-4bc0-9114-d447eefc0364 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.758767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae02158-fcec-4bc0-9114-d447eefc0364 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.759800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae02158-fcec-4bc0-9114-d447eefc0364 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.761037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae02158-fcec-4bc0-9114-d447eefc0364 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:39.763420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae02158-fcec-4bc0-9114-d447eefc0364 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:39.772661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9327190-9a82-4f14-886e-c9761778d859 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.800709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:39.817555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e80551-f201-4276-b9fd-c18624e10412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.818389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e80551-f201-4276-b9fd-c18624e10412 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.818707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e80551-f201-4276-b9fd-c18624e10412 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.819071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e80551-f201-4276-b9fd-c18624e10412 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.831658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e80551-f201-4276-b9fd-c18624e10412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-a0e80551-f201-4276-b9fd-c18624e10412 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:39.841116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:39.842395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:39.843356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 241/478] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:26:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:39.847853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e80551-f201-4276-b9fd-c18624e10412 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.954074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 238/479] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:26:39 2022] POST /identity/v3/users => generated 249 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:39.968262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e80551-f201-4276-b9fd-c18624e10412 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:40.010089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0264c9-0462-4bea-9c9d-5d8dadc3a8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:40.010754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0264c9-0462-4bea-9c9d-5d8dadc3a8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:40.011100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0264c9-0462-4bea-9c9d-5d8dadc3a8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:40.011437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0264c9-0462-4bea-9c9d-5d8dadc3a8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:40.012485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0264c9-0462-4bea-9c9d-5d8dadc3a8b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:40.012809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0264c9-0462-4bea-9c9d-5d8dadc3a8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:40.014259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0264c9-0462-4bea-9c9d-5d8dadc3a8b7 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:40.025249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 242/480] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:41.506359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a1c65-10ec-4a2a-ac92-6c32eadc2b26 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:41.507076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a1c65-10ec-4a2a-ac92-6c32eadc2b26 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:41.507207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a1c65-10ec-4a2a-ac92-6c32eadc2b26 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:41.508863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 239/481] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:41.515641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660b41c-a244-47d4-a5ee-9602aa313b53 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:41.516074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660b41c-a244-47d4-a5ee-9602aa313b53 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:41.516257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660b41c-a244-47d4-a5ee-9602aa313b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:41.537852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4660b41c-a244-47d4-a5ee-9602aa313b53 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:41.539513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4660b41c-a244-47d4-a5ee-9602aa313b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:41.580791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:41.634998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 243/482] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:41.681753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a1c65-10ec-4a2a-ac92-6c32eadc2b26 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:41.743406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f2b3d-f996-4f2c-8d18-ce004e6d1f6b None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:41.743729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f2b3d-f996-4f2c-8d18-ce004e6d1f6b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:41.743970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f2b3d-f996-4f2c-8d18-ce004e6d1f6b None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:41.745596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 244/483] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:41.750889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4a1d0-7b3f-461b-99bc-d54811e7376b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:41.751399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4a1d0-7b3f-461b-99bc-d54811e7376b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:41.751878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4a1d0-7b3f-461b-99bc-d54811e7376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:41.780559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-69b4a1d0-7b3f-461b-99bc-d54811e7376b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:41.782133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-69b4a1d0-7b3f-461b-99bc-d54811e7376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:41.804907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:41.830157 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a1c65-10ec-4a2a-ac92-6c32eadc2b26 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:41.894132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a4e25-b352-43de-a621-e1fc82ac1484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:41.894933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a4e25-b352-43de-a621-e1fc82ac1484 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:41.895209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a4e25-b352-43de-a621-e1fc82ac1484 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:41.895474 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a4e25-b352-43de-a621-e1fc82ac1484 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:41.918931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a4e25-b352-43de-a621-e1fc82ac1484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-cd5a4e25-b352-43de-a621-e1fc82ac1484 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:41.926944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:41.927927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:41.928768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 240/484] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:41.930295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 245/485] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:41.937630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4a1d0-7b3f-461b-99bc-d54811e7376b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:41.989548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a4e25-b352-43de-a621-e1fc82ac1484 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.066721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:42.080197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4a1d0-7b3f-461b-99bc-d54811e7376b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.125043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33266c4-03c0-431d-b392-621b21bf1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.127341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33266c4-03c0-431d-b392-621b21bf1331 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.127764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33266c4-03c0-431d-b392-621b21bf1331 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.128620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33266c4-03c0-431d-b392-621b21bf1331 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.129506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33266c4-03c0-431d-b392-621b21bf1331 None admin] RBAC: Adding query filter params (name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:42.131180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33266c4-03c0-431d-b392-621b21bf1331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.135347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33266c4-03c0-431d-b392-621b21bf1331 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.155211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 246/486] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:42.160686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33266c4-03c0-431d-b392-621b21bf1331 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.181372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a4e25-b352-43de-a621-e1fc82ac1484 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.221467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d86bd-0fb2-4cbf-99ea-ffb3208c046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.222634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d86bd-0fb2-4cbf-99ea-ffb3208c046d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.223061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d86bd-0fb2-4cbf-99ea-ffb3208c046d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.223771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d86bd-0fb2-4cbf-99ea-ffb3208c046d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.236727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d86bd-0fb2-4cbf-99ea-ffb3208c046d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-5d0d86bd-0fb2-4cbf-99ea-ffb3208c046d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:42.246566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:42.247658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:42.248626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:42.253916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 241/487] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:42.254945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d97bba-b0c5-4aae-9407-061746b6ae8d None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.255232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d97bba-b0c5-4aae-9407-061746b6ae8d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.255508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d97bba-b0c5-4aae-9407-061746b6ae8d None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.257673 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 242/488] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:42.263377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d97bba-b0c5-4aae-9407-061746b6ae8d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.296666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:42.307573 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33266c4-03c0-431d-b392-621b21bf1331 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.346838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37528d64-9c50-424b-8384-1f3f8614aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.347841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37528d64-9c50-424b-8384-1f3f8614aa1c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.348228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37528d64-9c50-424b-8384-1f3f8614aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.348637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37528d64-9c50-424b-8384-1f3f8614aa1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.360830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37528d64-9c50-424b-8384-1f3f8614aa1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.362452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37528d64-9c50-424b-8384-1f3f8614aa1c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-37528d64-9c50-424b-8384-1f3f8614aa1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:42.382984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:42.383867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:42.384742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:42.384742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:42.384742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:42.384742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:42.389049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 247/489] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:42.390636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cf712-f483-437e-ace3-af8d232fde56 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.390862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d97bba-b0c5-4aae-9407-061746b6ae8d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.390968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cf712-f483-437e-ace3-af8d232fde56 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.391189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cf712-f483-437e-ace3-af8d232fde56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.403827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:42.415021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9d3cf712-f483-437e-ace3-af8d232fde56 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:42.417080 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9d3cf712-f483-437e-ace3-af8d232fde56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:42.441211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c7389-e5a0-4c63-ad92-b8f8f071de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.442363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c7389-e5a0-4c63-ad92-b8f8f071de85 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.442647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c7389-e5a0-4c63-ad92-b8f8f071de85 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.442917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c7389-e5a0-4c63-ad92-b8f8f071de85 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.443741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c7389-e5a0-4c63-ad92-b8f8f071de85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:42.444043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c7389-e5a0-4c63-ad92-b8f8f071de85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.445494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c7389-e5a0-4c63-ad92-b8f8f071de85 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.460395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 243/490] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:42.461305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c7389-e5a0-4c63-ad92-b8f8f071de85 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.508539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 248/491] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:42.509555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cf712-f483-437e-ace3-af8d232fde56 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.543073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:42.590898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c7389-e5a0-4c63-ad92-b8f8f071de85 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.638326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab065b4-581b-438e-bc0f-2ab2700043f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.638937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab065b4-581b-438e-bc0f-2ab2700043f1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.639222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab065b4-581b-438e-bc0f-2ab2700043f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.639497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab065b4-581b-438e-bc0f-2ab2700043f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.640216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab065b4-581b-438e-bc0f-2ab2700043f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:42.640564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab065b4-581b-438e-bc0f-2ab2700043f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.641983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab065b4-581b-438e-bc0f-2ab2700043f1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.643800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cf712-f483-437e-ace3-af8d232fde56 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.655384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 244/492] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:42.657483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab065b4-581b-438e-bc0f-2ab2700043f1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.680636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f61db-cc05-4cfa-a9c6-dc74b05096da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.681439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f61db-cc05-4cfa-a9c6-dc74b05096da None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.681845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f61db-cc05-4cfa-a9c6-dc74b05096da None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.682128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f61db-cc05-4cfa-a9c6-dc74b05096da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.684932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:42.693041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f61db-cc05-4cfa-a9c6-dc74b05096da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.694686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f61db-cc05-4cfa-a9c6-dc74b05096da None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-a20f61db-cc05-4cfa-a9c6-dc74b05096da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:42.714827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:42.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:42.721078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:42.721078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:42.721078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:42.721078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:42.721078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 249/493] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:42.721078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab21562-0fc4-4d46-8c04-f9cacd5bffb0 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.721078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab21562-0fc4-4d46-8c04-f9cacd5bffb0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.721078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab21562-0fc4-4d46-8c04-f9cacd5bffb0 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.724608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 250/494] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:42.725189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab21562-0fc4-4d46-8c04-f9cacd5bffb0 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.773698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab065b4-581b-438e-bc0f-2ab2700043f1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.803381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:42.813013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb526d-0e4c-4f46-bd84-11b289ee8adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.814196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb526d-0e4c-4f46-bd84-11b289ee8adb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.814481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb526d-0e4c-4f46-bd84-11b289ee8adb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.814757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb526d-0e4c-4f46-bd84-11b289ee8adb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.827529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb526d-0e4c-4f46-bd84-11b289ee8adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-c2fb526d-0e4c-4f46-bd84-11b289ee8adb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:42.835909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:42.836863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:42.837648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:42.839403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab21562-0fc4-4d46-8c04-f9cacd5bffb0 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.840087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 245/495] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:42.840087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb526d-0e4c-4f46-bd84-11b289ee8adb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.879424 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a898ee1-7a0c-4751-85b6-55b99b2c35e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.880211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898ee1-7a0c-4751-85b6-55b99b2c35e4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.880518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898ee1-7a0c-4751-85b6-55b99b2c35e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.880790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898ee1-7a0c-4751-85b6-55b99b2c35e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.889737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a898ee1-7a0c-4751-85b6-55b99b2c35e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.891779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a898ee1-7a0c-4751-85b6-55b99b2c35e4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-4a898ee1-7a0c-4751-85b6-55b99b2c35e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:42.911116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:42.912073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:42.913682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 251/496] 10.222.0.74 () {56 vars in 1093 bytes} [Mon May 23 16:26:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:42.914259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab372765-266a-4921-8e0f-fdeb4baa7259 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.914326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab372765-266a-4921-8e0f-fdeb4baa7259 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.915006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab372765-266a-4921-8e0f-fdeb4baa7259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.932111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-ab372765-266a-4921-8e0f-fdeb4baa7259 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:42.933099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ab372765-266a-4921-8e0f-fdeb4baa7259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:42.961655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb526d-0e4c-4f46-bd84-11b289ee8adb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.981751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:42.997128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039c96-99d3-4650-9493-6fa5fb02b1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.997787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039c96-99d3-4650-9493-6fa5fb02b1da None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.998073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039c96-99d3-4650-9493-6fa5fb02b1da None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.998348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039c96-99d3-4650-9493-6fa5fb02b1da None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.999071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039c96-99d3-4650-9493-6fa5fb02b1da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:42.999375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039c96-99d3-4650-9493-6fa5fb02b1da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.000796 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039c96-99d3-4650-9493-6fa5fb02b1da None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.004488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 252/497] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:43.005305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab372765-266a-4921-8e0f-fdeb4baa7259 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.014705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 246/498] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:43.015440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039c96-99d3-4650-9493-6fa5fb02b1da None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.063992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.111531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab372765-266a-4921-8e0f-fdeb4baa7259 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.114348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039c96-99d3-4650-9493-6fa5fb02b1da None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.145457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bf3d4-f450-45f6-a5c2-09f5cc330e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.146052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bf3d4-f450-45f6-a5c2-09f5cc330e94 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.146336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bf3d4-f450-45f6-a5c2-09f5cc330e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.147276 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bf3d4-f450-45f6-a5c2-09f5cc330e94 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.148014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bf3d4-f450-45f6-a5c2-09f5cc330e94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:43.148340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bf3d4-f450-45f6-a5c2-09f5cc330e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.148876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5b97a-14d8-476f-833a-c885815fc809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.149545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5b97a-14d8-476f-833a-c885815fc809 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.149727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bf3d4-f450-45f6-a5c2-09f5cc330e94 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.149819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5b97a-14d8-476f-833a-c885815fc809 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.150095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5b97a-14d8-476f-833a-c885815fc809 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.150921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5b97a-14d8-476f-833a-c885815fc809 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:43.151234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5b97a-14d8-476f-833a-c885815fc809 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.152676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5b97a-14d8-476f-833a-c885815fc809 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.157602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 253/499] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:43.158800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75204e-2b75-4d51-a345-65b9685665b6 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.159091 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75204e-2b75-4d51-a345-65b9685665b6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.159364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75204e-2b75-4d51-a345-65b9685665b6 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.162091 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 254/500] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:43.162091 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75204e-2b75-4d51-a345-65b9685665b6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.197335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 247/501] 10.222.0.74 () {56 vars in 1133 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:43.197335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5b97a-14d8-476f-833a-c885815fc809 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.211064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.274886 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75204e-2b75-4d51-a345-65b9685665b6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.298082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5b97a-14d8-476f-833a-c885815fc809 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.305242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.307839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fffb72-c1fa-4884-b3e3-1bf4d24b273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.308652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fffb72-c1fa-4884-b3e3-1bf4d24b273e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.308932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fffb72-c1fa-4884-b3e3-1bf4d24b273e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.309200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fffb72-c1fa-4884-b3e3-1bf4d24b273e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.316624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fffb72-c1fa-4884-b3e3-1bf4d24b273e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.318068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fffb72-c1fa-4884-b3e3-1bf4d24b273e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.330776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf93eb-0bfe-41d0-9ee1-8ce9d5907422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.331564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf93eb-0bfe-41d0-9ee1-8ce9d5907422 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.331848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf93eb-0bfe-41d0-9ee1-8ce9d5907422 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-73fffb72-c1fa-4884-b3e3-1bf4d24b273e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:43.332109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:43.333142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 16:26:43.334589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:43.335162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf93eb-0bfe-41d0-9ee1-8ce9d5907422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.335232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 255/502] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:43.335232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fffb72-c1fa-4884-b3e3-1bf4d24b273e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.346899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf93eb-0bfe-41d0-9ee1-8ce9d5907422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.348410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf93eb-0bfe-41d0-9ee1-8ce9d5907422 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-c4cf93eb-0bfe-41d0-9ee1-8ce9d5907422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:43.367039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:43.367932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:43.368912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:43.368912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:43.368912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:43.368912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:43.368912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 248/503] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:43.369598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d989-c16f-424a-b64c-3c0fa0a273ac None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.369882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d989-c16f-424a-b64c-3c0fa0a273ac None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.370157 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d989-c16f-424a-b64c-3c0fa0a273ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.386435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c125d989-c16f-424a-b64c-3c0fa0a273ac None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:43.387632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c125d989-c16f-424a-b64c-3c0fa0a273ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:43.438757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.442264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fffb72-c1fa-4884-b3e3-1bf4d24b273e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.454544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 249/504] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:43.455385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125d989-c16f-424a-b64c-3c0fa0a273ac None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.483154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3963a9-42f1-4b93-9fff-7ea6c7b5851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.483954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3963a9-42f1-4b93-9fff-7ea6c7b5851a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.484240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3963a9-42f1-4b93-9fff-7ea6c7b5851a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.484561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3963a9-42f1-4b93-9fff-7ea6c7b5851a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.495498 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3963a9-42f1-4b93-9fff-7ea6c7b5851a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.496985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3963a9-42f1-4b93-9fff-7ea6c7b5851a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-2d3963a9-42f1-4b93-9fff-7ea6c7b5851a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:43.515153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:43.515979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:43.522090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:43.522090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:43.522090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:43.522090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:43.522090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 256/505] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:43.522090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3963a9-42f1-4b93-9fff-7ea6c7b5851a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.546103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.558663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125d989-c16f-424a-b64c-3c0fa0a273ac None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.592703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174df1d5-38d8-4b37-bb0d-5ab0dbf08976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.593355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174df1d5-38d8-4b37-bb0d-5ab0dbf08976 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.593650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174df1d5-38d8-4b37-bb0d-5ab0dbf08976 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.593934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174df1d5-38d8-4b37-bb0d-5ab0dbf08976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.616141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3963a9-42f1-4b93-9fff-7ea6c7b5851a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.650918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e55a6e-6463-4ee3-8820-46a87f2416f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.651583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e55a6e-6463-4ee3-8820-46a87f2416f9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.651874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e55a6e-6463-4ee3-8820-46a87f2416f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.652148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e55a6e-6463-4ee3-8820-46a87f2416f9 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.653020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e55a6e-6463-4ee3-8820-46a87f2416f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:43.653334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e55a6e-6463-4ee3-8820-46a87f2416f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.654788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e55a6e-6463-4ee3-8820-46a87f2416f9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.661524 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174df1d5-38d8-4b37-bb0d-5ab0dbf08976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.663761 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174df1d5-38d8-4b37-bb0d-5ab0dbf08976 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.690596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 257/506] 10.222.0.74 () {56 vars in 1137 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:43.691366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e55a6e-6463-4ee3-8820-46a87f2416f9 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.703883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.749443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.765975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 250/507] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:43.767169 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174df1d5-38d8-4b37-bb0d-5ab0dbf08976 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.792034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e55a6e-6463-4ee3-8820-46a87f2416f9 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.826377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5493-4a78-418c-8b46-a9f135ddfe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.827034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5493-4a78-418c-8b46-a9f135ddfe35 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.827318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5493-4a78-418c-8b46-a9f135ddfe35 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.827602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5493-4a78-418c-8b46-a9f135ddfe35 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.828343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5493-4a78-418c-8b46-a9f135ddfe35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:43.828654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5493-4a78-418c-8b46-a9f135ddfe35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.830047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5493-4a78-418c-8b46-a9f135ddfe35 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.841316 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 258/508] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:43.842190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5493-4a78-418c-8b46-a9f135ddfe35 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.872873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174df1d5-38d8-4b37-bb0d-5ab0dbf08976 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.906332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078dc8d-6f73-468f-a9d7-0c3b571baa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.907130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078dc8d-6f73-468f-a9d7-0c3b571baa73 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.907418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078dc8d-6f73-468f-a9d7-0c3b571baa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.907698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078dc8d-6f73-468f-a9d7-0c3b571baa73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.909839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.918190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078dc8d-6f73-468f-a9d7-0c3b571baa73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-0078dc8d-6f73-468f-a9d7-0c3b571baa73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:43.925939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:43.926830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:43.927648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 251/509] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:43.928339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078dc8d-6f73-468f-a9d7-0c3b571baa73 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.943056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5493-4a78-418c-8b46-a9f135ddfe35 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.977246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d59897-7ce4-4262-8736-ac558f04f40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.977914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d59897-7ce4-4262-8736-ac558f04f40d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.978200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d59897-7ce4-4262-8736-ac558f04f40d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.978481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d59897-7ce4-4262-8736-ac558f04f40d None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.979059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.979231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d59897-7ce4-4262-8736-ac558f04f40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:43.979505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d59897-7ce4-4262-8736-ac558f04f40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.980941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d59897-7ce4-4262-8736-ac558f04f40d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.993417 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 259/510] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:43.994216 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d59897-7ce4-4262-8736-ac558f04f40d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.030478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078dc8d-6f73-468f-a9d7-0c3b571baa73 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.063270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cde5db-1eb1-4606-bc63-80db461ab46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.063911 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cde5db-1eb1-4606-bc63-80db461ab46f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.064197 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cde5db-1eb1-4606-bc63-80db461ab46f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.064519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cde5db-1eb1-4606-bc63-80db461ab46f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.092278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d59897-7ce4-4262-8736-ac558f04f40d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.121023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:44.126186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc200223-8063-4659-81db-172e220db46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.126968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc200223-8063-4659-81db-172e220db46c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.127249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc200223-8063-4659-81db-172e220db46c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.127521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc200223-8063-4659-81db-172e220db46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.132108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cde5db-1eb1-4606-bc63-80db461ab46f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.134194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cde5db-1eb1-4606-bc63-80db461ab46f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.137353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc200223-8063-4659-81db-172e220db46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.138796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc200223-8063-4659-81db-172e220db46c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-bc200223-8063-4659-81db-172e220db46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:44.157102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:44.157967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:44.158804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:44.158804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:44.158804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:44.158804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:44.158804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 260/511] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:44.159563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc200223-8063-4659-81db-172e220db46c None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.186772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:44.238750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 252/512] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:44.239598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cde5db-1eb1-4606-bc63-80db461ab46f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.264287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc200223-8063-4659-81db-172e220db46c None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.300782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902a8d6-b47b-4949-9dab-f5ef48c7a5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.301449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902a8d6-b47b-4949-9dab-f5ef48c7a5e3 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.301731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902a8d6-b47b-4949-9dab-f5ef48c7a5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.302007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902a8d6-b47b-4949-9dab-f5ef48c7a5e3 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.302727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902a8d6-b47b-4949-9dab-f5ef48c7a5e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.304169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902a8d6-b47b-4949-9dab-f5ef48c7a5e3 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.337305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cde5db-1eb1-4606-bc63-80db461ab46f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.371548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a443-7970-477f-9f57-008330d6ae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.372212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a443-7970-477f-9f57-008330d6ae4c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.372524 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a443-7970-477f-9f57-008330d6ae4c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.372798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a443-7970-477f-9f57-008330d6ae4c None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.373535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9a443-7970-477f-9f57-008330d6ae4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:44.373838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9a443-7970-477f-9f57-008330d6ae4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.375341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9a443-7970-477f-9f57-008330d6ae4c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.383131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 253/513] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:44.383918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a443-7970-477f-9f57-008330d6ae4c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.400333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 261/514] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:26:44 2022] POST /identity/v3/users => generated 247 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:44.400333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902a8d6-b47b-4949-9dab-f5ef48c7a5e3 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.400645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:44.454179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:44.501595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a443-7970-477f-9f57-008330d6ae4c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.527030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902a8d6-b47b-4949-9dab-f5ef48c7a5e3 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.548081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a28276-50a2-433c-b77e-94a64f7dc44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.548950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a28276-50a2-433c-b77e-94a64f7dc44f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.549235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a28276-50a2-433c-b77e-94a64f7dc44f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.549508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a28276-50a2-433c-b77e-94a64f7dc44f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.558510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a28276-50a2-433c-b77e-94a64f7dc44f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.560007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a28276-50a2-433c-b77e-94a64f7dc44f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.567007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599f411-60af-4749-9754-6b3c33be1db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.568375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599f411-60af-4749-9754-6b3c33be1db9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.568639 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599f411-60af-4749-9754-6b3c33be1db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.569072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599f411-60af-4749-9754-6b3c33be1db9 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.570057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599f411-60af-4749-9754-6b3c33be1db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:44.570369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599f411-60af-4749-9754-6b3c33be1db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.571772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599f411-60af-4749-9754-6b3c33be1db9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-60a28276-50a2-433c-b77e-94a64f7dc44f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:44.577002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:44.578065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:44.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 254/515] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:44.579528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a28276-50a2-433c-b77e-94a64f7dc44f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.585558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 262/516] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:44.586746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599f411-60af-4749-9754-6b3c33be1db9 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.672441 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:44.694491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:44.698475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599f411-60af-4749-9754-6b3c33be1db9 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.709238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a28276-50a2-433c-b77e-94a64f7dc44f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.733582 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c36461-3713-47b6-9142-1e1719a39005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.734374 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c36461-3713-47b6-9142-1e1719a39005 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.734662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c36461-3713-47b6-9142-1e1719a39005 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.734924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c36461-3713-47b6-9142-1e1719a39005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.746854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c36461-3713-47b6-9142-1e1719a39005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.747149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936f1c4-6833-4b92-9156-e1f2bd6e8357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.747947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936f1c4-6833-4b92-9156-e1f2bd6e8357 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.748232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936f1c4-6833-4b92-9156-e1f2bd6e8357 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.748532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936f1c4-6833-4b92-9156-e1f2bd6e8357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.752658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c36461-3713-47b6-9142-1e1719a39005 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.760003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936f1c4-6833-4b92-9156-e1f2bd6e8357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.761505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936f1c4-6833-4b92-9156-e1f2bd6e8357 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-62c36461-3713-47b6-9142-1e1719a39005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:44.768643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:44.769525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:44.770371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:44.770371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:44.770371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:44.770371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:44.770371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 263/517] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:44.770907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c36461-3713-47b6-9142-1e1719a39005 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-e936f1c4-6833-4b92-9156-e1f2bd6e8357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:44.786150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:44.788516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:44.790389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:44.790389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:44.790389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:44.790389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:44.799521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 255/518] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:44.800557 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936f1c4-6833-4b92-9156-e1f2bd6e8357 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.888208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c36461-3713-47b6-9142-1e1719a39005 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.908392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936f1c4-6833-4b92-9156-e1f2bd6e8357 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:44.926877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8713de4-aa57-4043-8f11-37b787e42057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.926877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713de4-aa57-4043-8f11-37b787e42057 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.926877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713de4-aa57-4043-8f11-37b787e42057 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.926877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713de4-aa57-4043-8f11-37b787e42057 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.927408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8713de4-aa57-4043-8f11-37b787e42057 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:44.927748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8713de4-aa57-4043-8f11-37b787e42057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.929430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8713de4-aa57-4043-8f11-37b787e42057 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.934619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:44.947485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5e14c-e98f-463a-abfc-20675e6bf9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:44.947998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 264/519] 10.222.0.74 () {56 vars in 1137 bytes} [Mon May 23 16:26:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:44.948289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5e14c-e98f-463a-abfc-20675e6bf9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:44.948654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5e14c-e98f-463a-abfc-20675e6bf9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:44.948933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5e14c-e98f-463a-abfc-20675e6bf9e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:44.953147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8713de4-aa57-4043-8f11-37b787e42057 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:44.955796 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5e14c-e98f-463a-abfc-20675e6bf9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:44.957304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5e14c-e98f-463a-abfc-20675e6bf9e3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:44.965179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-e5a5e14c-e98f-463a-abfc-20675e6bf9e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:44.973662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:44.980391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 256/520] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:44.981410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5e14c-e98f-463a-abfc-20675e6bf9e3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.064273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8713de4-aa57-4043-8f11-37b787e42057 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:45.088022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5e14c-e98f-463a-abfc-20675e6bf9e3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:45.099891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be585358-d331-46d5-9231-27ea5f54613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:45.100597 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be585358-d331-46d5-9231-27ea5f54613b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:45.100883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be585358-d331-46d5-9231-27ea5f54613b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:45.101160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be585358-d331-46d5-9231-27ea5f54613b None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:45.101888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be585358-d331-46d5-9231-27ea5f54613b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:45.102197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be585358-d331-46d5-9231-27ea5f54613b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:45.103597 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be585358-d331-46d5-9231-27ea5f54613b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:45.119830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 265/521] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:45.119830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be585358-d331-46d5-9231-27ea5f54613b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.130451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1564d-eab5-40f5-852c-c7a6e81a9ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:45.131263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1564d-eab5-40f5-852c-c7a6e81a9ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:45.131891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1564d-eab5-40f5-852c-c7a6e81a9ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:45.132170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1564d-eab5-40f5-852c-c7a6e81a9ac2 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:45.133227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1564d-eab5-40f5-852c-c7a6e81a9ac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:45.133541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1564d-eab5-40f5-852c-c7a6e81a9ac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:45.135092 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1564d-eab5-40f5-852c-c7a6e81a9ac2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:45.152465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 257/522] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:45.152465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1564d-eab5-40f5-852c-c7a6e81a9ac2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.197735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:45.197928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:45.234945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be585358-d331-46d5-9231-27ea5f54613b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:45.262200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1564d-eab5-40f5-852c-c7a6e81a9ac2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:45.270641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608b557-4ea6-4649-9043-9406efa1a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:45.271296 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608b557-4ea6-4649-9043-9406efa1a722 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:45.271654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608b557-4ea6-4649-9043-9406efa1a722 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:45.272412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608b557-4ea6-4649-9043-9406efa1a722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:45.299093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb4dd-72c4-4828-9d53-ffdd35417e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:45.300250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb4dd-72c4-4828-9d53-ffdd35417e92 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:45.300775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb4dd-72c4-4828-9d53-ffdd35417e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:45.301292 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb4dd-72c4-4828-9d53-ffdd35417e92 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:45.302522 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb4dd-72c4-4828-9d53-ffdd35417e92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:45.302984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb4dd-72c4-4828-9d53-ffdd35417e92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:45.304562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb4dd-72c4-4828-9d53-ffdd35417e92 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:45.328420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 258/523] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:45.328420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb4dd-72c4-4828-9d53-ffdd35417e92 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.345681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608b557-4ea6-4649-9043-9406efa1a722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:45.347157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608b557-4ea6-4649-9043-9406efa1a722 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:45.412879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:45.433054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb4dd-72c4-4828-9d53-ffdd35417e92 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:45.434776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:45.445792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 266/524] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:45.446621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608b557-4ea6-4649-9043-9406efa1a722 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.472939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbda6eb-62f3-41f2-b385-97010547f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:45.473989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda6eb-62f3-41f2-b385-97010547f0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:45.474416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda6eb-62f3-41f2-b385-97010547f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:45.475437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda6eb-62f3-41f2-b385-97010547f0e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:45.483825 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbda6eb-62f3-41f2-b385-97010547f0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:45.485623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbda6eb-62f3-41f2-b385-97010547f0e1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-7fbda6eb-62f3-41f2-b385-97010547f0e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:45.500555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:45.501609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:26:45.502685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:45.504678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 259/525] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:45.505481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbda6eb-62f3-41f2-b385-97010547f0e1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.558120 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608b557-4ea6-4649-9043-9406efa1a722 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:45.593773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42134-66fa-4700-985f-d80894fcbbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:45.594503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42134-66fa-4700-985f-d80894fcbbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:45.594779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42134-66fa-4700-985f-d80894fcbbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:45.595054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42134-66fa-4700-985f-d80894fcbbd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:45.602362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b42134-66fa-4700-985f-d80894fcbbd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:45.603812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b42134-66fa-4700-985f-d80894fcbbd5 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-81b42134-66fa-4700-985f-d80894fcbbd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:45.618148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:45.619029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:45.619876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:45.619876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:45.619876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:45.619876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:45.619876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:45.619876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:45.619876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:45.619876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:45.619876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 267/526] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:45.620365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42134-66fa-4700-985f-d80894fcbbd5 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.630592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbda6eb-62f3-41f2-b385-97010547f0e1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:45.654482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:45.668123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41423c91-f4e8-4c99-a625-dd5877e16de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:45.668854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41423c91-f4e8-4c99-a625-dd5877e16de7 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:45.669135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41423c91-f4e8-4c99-a625-dd5877e16de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:45.669463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41423c91-f4e8-4c99-a625-dd5877e16de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:45.670309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41423c91-f4e8-4c99-a625-dd5877e16de7 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=951eca3289634609bcb684181e147ca3) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:45.684432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41423c91-f4e8-4c99-a625-dd5877e16de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:45.684432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41423c91-f4e8-4c99-a625-dd5877e16de7 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:45.684432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 260/527] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:45 2022] GET /identity/v3/role_assignments?user.id=951eca3289634609bcb684181e147ca3&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:45.684432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41423c91-f4e8-4c99-a625-dd5877e16de7 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.731187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:45.741262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42134-66fa-4700-985f-d80894fcbbd5 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:45.783827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b9732-a836-4c44-8a7b-ae3aab166804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:45.785068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b9732-a836-4c44-8a7b-ae3aab166804 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:45.785567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b9732-a836-4c44-8a7b-ae3aab166804 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:45.786077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b9732-a836-4c44-8a7b-ae3aab166804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:45.799738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b9732-a836-4c44-8a7b-ae3aab166804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:45.801756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b9732-a836-4c44-8a7b-ae3aab166804 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-0d6b9732-a836-4c44-8a7b-ae3aab166804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:45.822159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:45.823137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:45.823997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:45.823997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:45.823997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:45.823997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:45.826593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 268/528] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:45.827777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b9732-a836-4c44-8a7b-ae3aab166804 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.836260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41423c91-f4e8-4c99-a625-dd5877e16de7 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:45.887569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80575dd3-26cc-4c67-aecd-555808c0c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:45.888172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575dd3-26cc-4c67-aecd-555808c0c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:45.888491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575dd3-26cc-4c67-aecd-555808c0c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:45.888771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575dd3-26cc-4c67-aecd-555808c0c5d2 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:45.889627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80575dd3-26cc-4c67-aecd-555808c0c5d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:45.889933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80575dd3-26cc-4c67-aecd-555808c0c5d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:45.891390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80575dd3-26cc-4c67-aecd-555808c0c5d2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:45.915699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 261/529] 10.222.0.74 () {56 vars in 1139 bytes} [Mon May 23 16:26:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:45.915699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80575dd3-26cc-4c67-aecd-555808c0c5d2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:45.940040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:45.967254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b9732-a836-4c44-8a7b-ae3aab166804 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:46.009195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb3869-cd37-49eb-819a-43c4365ff243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:46.009860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb3869-cd37-49eb-819a-43c4365ff243 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.010148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb3869-cd37-49eb-819a-43c4365ff243 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.010432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb3869-cd37-49eb-819a-43c4365ff243 None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.011282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb3869-cd37-49eb-819a-43c4365ff243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:46.011600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb3869-cd37-49eb-819a-43c4365ff243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:46.013096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb3869-cd37-49eb-819a-43c4365ff243 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:46.019863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:46.031855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 269/530] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:46.032849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb3869-cd37-49eb-819a-43c4365ff243 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:46.040362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80575dd3-26cc-4c67-aecd-555808c0c5d2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:46.092333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63f735-5768-4919-bf1b-35fe157feb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:46.093365 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f735-5768-4919-bf1b-35fe157feb44 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.093887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f735-5768-4919-bf1b-35fe157feb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.094301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f735-5768-4919-bf1b-35fe157feb44 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.095864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63f735-5768-4919-bf1b-35fe157feb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:46.096380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63f735-5768-4919-bf1b-35fe157feb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:46.098471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63f735-5768-4919-bf1b-35fe157feb44 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:46.120006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 262/531] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:46.120601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63f735-5768-4919-bf1b-35fe157feb44 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:46.154939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb3869-cd37-49eb-819a-43c4365ff243 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:46.203087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62d0b-cafc-4971-b358-d4886fae2c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:46.203752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62d0b-cafc-4971-b358-d4886fae2c0a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.204401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62d0b-cafc-4971-b358-d4886fae2c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.204687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62d0b-cafc-4971-b358-d4886fae2c0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.220196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:46.245059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63f735-5768-4919-bf1b-35fe157feb44 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:46.283915 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62d0b-cafc-4971-b358-d4886fae2c0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:46.285584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62d0b-cafc-4971-b358-d4886fae2c0a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:46.290641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ae2e-c659-4caa-8adc-18207626ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:46.291518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ae2e-c659-4caa-8adc-18207626ccda None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.291941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ae2e-c659-4caa-8adc-18207626ccda None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.292379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ae2e-c659-4caa-8adc-18207626ccda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.293348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ae2e-c659-4caa-8adc-18207626ccda None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=e9533e8371e64161a4c54eeab867a17e) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:46.293818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ae2e-c659-4caa-8adc-18207626ccda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:46.295929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ae2e-c659-4caa-8adc-18207626ccda None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:46.304750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 263/532] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:46 2022] GET /identity/v3/role_assignments?user.id=e9533e8371e64161a4c54eeab867a17e&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:46.305986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ae2e-c659-4caa-8adc-18207626ccda None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:46.332018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:46.428795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 270/533] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:46.434904 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62d0b-cafc-4971-b358-d4886fae2c0a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:46.499653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:46.538600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ae2e-c659-4caa-8adc-18207626ccda None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:46.575189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62d0b-cafc-4971-b358-d4886fae2c0a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:46.598005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44820e-d301-4a7f-b0a8-5faf13e3fe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:46.599135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44820e-d301-4a7f-b0a8-5faf13e3fe75 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.599652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44820e-d301-4a7f-b0a8-5faf13e3fe75 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.600106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44820e-d301-4a7f-b0a8-5faf13e3fe75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.617751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44820e-d301-4a7f-b0a8-5faf13e3fe75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:46.619558 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44820e-d301-4a7f-b0a8-5faf13e3fe75 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:46.636717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73e4a2-fdf7-40ad-8f28-02df6079333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:46.637859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73e4a2-fdf7-40ad-8f28-02df6079333b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.638361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73e4a2-fdf7-40ad-8f28-02df6079333b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.638843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73e4a2-fdf7-40ad-8f28-02df6079333b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-7e44820e-d301-4a7f-b0a8-5faf13e3fe75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:46.649233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:46.650442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:46.651278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:46.651278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:46.651278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:46.651278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:46.651278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:46.651278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:46.651278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:46.651278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:46.653627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73e4a2-fdf7-40ad-8f28-02df6079333b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:46.655476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73e4a2-fdf7-40ad-8f28-02df6079333b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:46.660330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 264/534] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:46.673341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44820e-d301-4a7f-b0a8-5faf13e3fe75 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-7f73e4a2-fdf7-40ad-8f28-02df6079333b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:46.680499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:46.681359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:46.682242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:46.682242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:46.682242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:46.682242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:46.684756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 271/535] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:46.690364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73e4a2-fdf7-40ad-8f28-02df6079333b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:46.784440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:46.808494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:46.821318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73e4a2-fdf7-40ad-8f28-02df6079333b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:46.848167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44820e-d301-4a7f-b0a8-5faf13e3fe75 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:46.872362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f581b-b2b1-4206-a310-46f0bc48a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:46.873271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f581b-b2b1-4206-a310-46f0bc48a64a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.873723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f581b-b2b1-4206-a310-46f0bc48a64a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.874184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f581b-b2b1-4206-a310-46f0bc48a64a None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.875652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f581b-b2b1-4206-a310-46f0bc48a64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:46.876142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f581b-b2b1-4206-a310-46f0bc48a64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:46.878336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f581b-b2b1-4206-a310-46f0bc48a64a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:46.894890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 272/536] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:46.897235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ad330-0929-4062-b58b-7faf4f953240 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.897942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ad330-0929-4062-b58b-7faf4f953240 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.898434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ad330-0929-4062-b58b-7faf4f953240 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.904441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 273/537] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:46.905819 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028da8f2-cd4f-4ffa-94a0-3d414d29998b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.906308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028da8f2-cd4f-4ffa-94a0-3d414d29998b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.907765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028da8f2-cd4f-4ffa-94a0-3d414d29998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.908100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14e37-2c8e-4ba3-9a2f-f3374d079cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:46.908792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14e37-2c8e-4ba3-9a2f-f3374d079cff None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:46.909073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14e37-2c8e-4ba3-9a2f-f3374d079cff None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:46.909346 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14e37-2c8e-4ba3-9a2f-f3374d079cff None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:46.911393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e14e37-2c8e-4ba3-9a2f-f3374d079cff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:46.911708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e14e37-2c8e-4ba3-9a2f-f3374d079cff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:46.918287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e14e37-2c8e-4ba3-9a2f-f3374d079cff None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:46.946633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 265/538] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:46.946633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14e37-2c8e-4ba3-9a2f-f3374d079cff None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:46.948545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-028da8f2-cd4f-4ffa-94a0-3d414d29998b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:46.950029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-028da8f2-cd4f-4ffa-94a0-3d414d29998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:47.051782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 274/539] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:47.053659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028da8f2-cd4f-4ffa-94a0-3d414d29998b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:47.149840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:47.179348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028da8f2-cd4f-4ffa-94a0-3d414d29998b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:47.228321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14e37-2c8e-4ba3-9a2f-f3374d079cff None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:47.269446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280135d2-ee71-4a54-a896-fb0a05d5850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:47.270384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280135d2-ee71-4a54-a896-fb0a05d5850f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:47.270807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280135d2-ee71-4a54-a896-fb0a05d5850f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:47.271186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280135d2-ee71-4a54-a896-fb0a05d5850f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:47.273726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280135d2-ee71-4a54-a896-fb0a05d5850f None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=6d377792af1c4ad19519e2e98bac72e5) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:47.275705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280135d2-ee71-4a54-a896-fb0a05d5850f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:47.279252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280135d2-ee71-4a54-a896-fb0a05d5850f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:47.290211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:47.294692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 275/540] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:47 2022] GET /identity/v3/role_assignments?user.id=6d377792af1c4ad19519e2e98bac72e5&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:47.297872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280135d2-ee71-4a54-a896-fb0a05d5850f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:47.315393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e0e01-2b9d-4629-b0fb-4fd1f45ed09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:47.316217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e0e01-2b9d-4629-b0fb-4fd1f45ed09d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:47.316527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e0e01-2b9d-4629-b0fb-4fd1f45ed09d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:47.316805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e0e01-2b9d-4629-b0fb-4fd1f45ed09d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:47.330385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e0e01-2b9d-4629-b0fb-4fd1f45ed09d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:47.333093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e0e01-2b9d-4629-b0fb-4fd1f45ed09d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-a84e0e01-2b9d-4629-b0fb-4fd1f45ed09d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:47.363299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:47.364217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:47.365616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:47.365616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:47.365616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:47.365616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:47.365616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:47.365616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:47.365616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:47.365616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:47.373462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 266/541] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:47.379874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e0e01-2b9d-4629-b0fb-4fd1f45ed09d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:47.489222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280135d2-ee71-4a54-a896-fb0a05d5850f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:47.548281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e0e01-2b9d-4629-b0fb-4fd1f45ed09d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:47.564587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa322a-ecfc-44b7-bd5a-b1569a3d2231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:47.565407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa322a-ecfc-44b7-bd5a-b1569a3d2231 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:47.565693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa322a-ecfc-44b7-bd5a-b1569a3d2231 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:47.566031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa322a-ecfc-44b7-bd5a-b1569a3d2231 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:47.590211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744683-4a59-4b4f-b22d-6a938f643ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:47.591235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744683-4a59-4b4f-b22d-6a938f643ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:47.591716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744683-4a59-4b4f-b22d-6a938f643ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:47.592202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744683-4a59-4b4f-b22d-6a938f643ff4 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:47.593456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6744683-4a59-4b4f-b22d-6a938f643ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:47.594162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa322a-ecfc-44b7-bd5a-b1569a3d2231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-fdfa322a-ecfc-44b7-bd5a-b1569a3d2231 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:47.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:47.603579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:47.604387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:47.605864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6744683-4a59-4b4f-b22d-6a938f643ff4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:47.607567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6744683-4a59-4b4f-b22d-6a938f643ff4 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:47.620186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 276/542] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:47.623589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 267/543] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:47.624731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa322a-ecfc-44b7-bd5a-b1569a3d2231 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:47.632342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744683-4a59-4b4f-b22d-6a938f643ff4 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:47.640860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:47.732670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:47.817156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744683-4a59-4b4f-b22d-6a938f643ff4 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:47.840468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa322a-ecfc-44b7-bd5a-b1569a3d2231 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:47.880767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453e438-9111-4755-990f-e15994eb2de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:47.882138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453e438-9111-4755-990f-e15994eb2de6 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:47.883106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453e438-9111-4755-990f-e15994eb2de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:47.883898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9ff1-ff2c-4c6a-ab48-9ca70ca18952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:47.884420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453e438-9111-4755-990f-e15994eb2de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:47.885283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9ff1-ff2c-4c6a-ab48-9ca70ca18952 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:47.886241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453e438-9111-4755-990f-e15994eb2de6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:47.886717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9ff1-ff2c-4c6a-ab48-9ca70ca18952 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:47.887199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9ff1-ff2c-4c6a-ab48-9ca70ca18952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:47.887698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453e438-9111-4755-990f-e15994eb2de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:47.888770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb9ff1-ff2c-4c6a-ab48-9ca70ca18952 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=a833149a66af4452aeedd5d43f2fb2eb) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:47.890373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453e438-9111-4755-990f-e15994eb2de6 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:47.890897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb9ff1-ff2c-4c6a-ab48-9ca70ca18952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:47.894358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb9ff1-ff2c-4c6a-ab48-9ca70ca18952 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:47.908508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 277/545] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:47.908984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 268/545] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:47 2022] GET /identity/v3/role_assignments?user.id=a833149a66af4452aeedd5d43f2fb2eb&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:47.916372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453e438-9111-4755-990f-e15994eb2de6 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:48.047014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:48.097951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453e438-9111-4755-990f-e15994eb2de6 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:48.145471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1527c-b7a6-4802-9b82-3b79ec37f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:48.146809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1527c-b7a6-4802-9b82-3b79ec37f717 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.147097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1527c-b7a6-4802-9b82-3b79ec37f717 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.147530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1527c-b7a6-4802-9b82-3b79ec37f717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.160768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1527c-b7a6-4802-9b82-3b79ec37f717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:48.162470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1527c-b7a6-4802-9b82-3b79ec37f717 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-0cf1527c-b7a6-4802-9b82-3b79ec37f717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:48.186195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:48.187121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:48.188656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:48.188656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:48.188656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:48.188656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:48.188656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 278/546] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:48.193749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9ff1-ff2c-4c6a-ab48-9ca70ca18952 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:48.253338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8d15-8200-4ae7-bdca-da925fc10b8b None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.253677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8d15-8200-4ae7-bdca-da925fc10b8b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.253892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8d15-8200-4ae7-bdca-da925fc10b8b None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.255692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 279/547] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:48.261348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66ff6e-43ad-4213-b0a8-2de0baa2b22c None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.261670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66ff6e-43ad-4213-b0a8-2de0baa2b22c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.261932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66ff6e-43ad-4213-b0a8-2de0baa2b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.281649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-ad66ff6e-43ad-4213-b0a8-2de0baa2b22c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:48.282961 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ad66ff6e-43ad-4213-b0a8-2de0baa2b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:48.391971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9ff1-ff2c-4c6a-ab48-9ca70ca18952 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:48.404436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 280/548] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:48.411192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:48.429859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66ff6e-43ad-4213-b0a8-2de0baa2b22c None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:48.453188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13af8b3-3bb5-4b62-979a-4905593d29e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:48.453916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13af8b3-3bb5-4b62-979a-4905593d29e6 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.454142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13af8b3-3bb5-4b62-979a-4905593d29e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.454424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13af8b3-3bb5-4b62-979a-4905593d29e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.455161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13af8b3-3bb5-4b62-979a-4905593d29e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:48.455471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13af8b3-3bb5-4b62-979a-4905593d29e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:48.456891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13af8b3-3bb5-4b62-979a-4905593d29e6 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:48.481665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 269/549] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:48.486755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13af8b3-3bb5-4b62-979a-4905593d29e6 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:48.487949 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:48.552250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66ff6e-43ad-4213-b0a8-2de0baa2b22c None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:48.619763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5d174-e406-41a5-8894-7c6560772783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:48.620838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5d174-e406-41a5-8894-7c6560772783 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.621291 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5d174-e406-41a5-8894-7c6560772783 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.621747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5d174-e406-41a5-8894-7c6560772783 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.643242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5d174-e406-41a5-8894-7c6560772783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-b0b5d174-e406-41a5-8894-7c6560772783 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:48.652912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:48.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:48.654659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:48.657548 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 281/550] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:48.665910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5d174-e406-41a5-8894-7c6560772783 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:48.683435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13af8b3-3bb5-4b62-979a-4905593d29e6 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:48.744765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1386f57-f492-4c83-9aa1-dc2cbc024a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:48.745926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1386f57-f492-4c83-9aa1-dc2cbc024a48 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.746282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1386f57-f492-4c83-9aa1-dc2cbc024a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.746628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1386f57-f492-4c83-9aa1-dc2cbc024a48 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.758920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1386f57-f492-4c83-9aa1-dc2cbc024a48 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:48.761373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1386f57-f492-4c83-9aa1-dc2cbc024a48 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-f1386f57-f492-4c83-9aa1-dc2cbc024a48 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:48.783025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:48.784150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:26:48.785377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:48.788371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 270/551] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:26:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:48.789958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67308ed-40e8-4526-bd9b-821b13f44735 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.791706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67308ed-40e8-4526-bd9b-821b13f44735 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.792846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67308ed-40e8-4526-bd9b-821b13f44735 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.794391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 271/552] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:48.799895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67308ed-40e8-4526-bd9b-821b13f44735 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:48.823241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5d174-e406-41a5-8894-7c6560772783 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:48.836797 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:48.843107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:48.864233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064fa2c-d649-41db-92e0-3e9b51986354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:48.867281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064fa2c-d649-41db-92e0-3e9b51986354 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.867972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064fa2c-d649-41db-92e0-3e9b51986354 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.868493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064fa2c-d649-41db-92e0-3e9b51986354 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.869528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064fa2c-d649-41db-92e0-3e9b51986354 None admin] RBAC: Adding query filter params (name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:48.870059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064fa2c-d649-41db-92e0-3e9b51986354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:48.871774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064fa2c-d649-41db-92e0-3e9b51986354 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:48.882619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 282/553] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:48.884249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6d9cb-e6fa-432c-8182-88ac590752b7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.884846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6d9cb-e6fa-432c-8182-88ac590752b7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.885329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6d9cb-e6fa-432c-8182-88ac590752b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.907567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8db6d9cb-e6fa-432c-8182-88ac590752b7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:48.909256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8db6d9cb-e6fa-432c-8182-88ac590752b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:48.936925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67308ed-40e8-4526-bd9b-821b13f44735 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:48.981242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032d0d9-41c2-4be7-b7d6-7f3aa42daa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:48.981916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032d0d9-41c2-4be7-b7d6-7f3aa42daa36 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:48.982200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032d0d9-41c2-4be7-b7d6-7f3aa42daa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:48.982476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032d0d9-41c2-4be7-b7d6-7f3aa42daa36 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:48.983988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032d0d9-41c2-4be7-b7d6-7f3aa42daa36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:48.984324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032d0d9-41c2-4be7-b7d6-7f3aa42daa36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:48.985874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032d0d9-41c2-4be7-b7d6-7f3aa42daa36 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:48.988558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 283/554] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:48.989733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6d9cb-e6fa-432c-8182-88ac590752b7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:49.023162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 272/555] 10.222.0.74 () {56 vars in 1135 bytes} [Mon May 23 16:26:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:49.024531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032d0d9-41c2-4be7-b7d6-7f3aa42daa36 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:49.118128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6d9cb-e6fa-432c-8182-88ac590752b7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:49.120488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:49.145753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:49.156335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166f387-3a06-4981-9f1f-b66c544fd01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:49.156981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032d0d9-41c2-4be7-b7d6-7f3aa42daa36 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:49.157711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166f387-3a06-4981-9f1f-b66c544fd01f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:49.159272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166f387-3a06-4981-9f1f-b66c544fd01f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:49.159763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166f387-3a06-4981-9f1f-b66c544fd01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:49.171323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166f387-3a06-4981-9f1f-b66c544fd01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:49.173158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166f387-3a06-4981-9f1f-b66c544fd01f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-5166f387-3a06-4981-9f1f-b66c544fd01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:49.192837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:49.194445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:49.195404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:49.195404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:49.195404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:49.195404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:49.197961 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 284/556] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:49.200184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166f387-3a06-4981-9f1f-b66c544fd01f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:49.202836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722cc89-01b5-46cd-9850-a1cc8c3901f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:49.203668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722cc89-01b5-46cd-9850-a1cc8c3901f9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:49.203948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722cc89-01b5-46cd-9850-a1cc8c3901f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:49.204228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722cc89-01b5-46cd-9850-a1cc8c3901f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:49.222572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722cc89-01b5-46cd-9850-a1cc8c3901f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-b722cc89-01b5-46cd-9850-a1cc8c3901f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:49.232544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:49.233463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:49.234795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:49.238921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 273/557] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:49.240232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722cc89-01b5-46cd-9850-a1cc8c3901f9 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:49.321856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166f387-3a06-4981-9f1f-b66c544fd01f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:49.362289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01a45f-8d94-4d19-a1cf-8870ec969c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:49.363306 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a45f-8d94-4d19-a1cf-8870ec969c70 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:49.363792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a45f-8d94-4d19-a1cf-8870ec969c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:49.364377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a45f-8d94-4d19-a1cf-8870ec969c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:49.370387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722cc89-01b5-46cd-9850-a1cc8c3901f9 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:49.395428 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:49.413941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343bd7b-3da1-4143-96fd-dc9f9ad9b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:49.414989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343bd7b-3da1-4143-96fd-dc9f9ad9b425 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:49.415356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343bd7b-3da1-4143-96fd-dc9f9ad9b425 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:49.415637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343bd7b-3da1-4143-96fd-dc9f9ad9b425 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:49.416458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343bd7b-3da1-4143-96fd-dc9f9ad9b425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:49.416769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343bd7b-3da1-4143-96fd-dc9f9ad9b425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:49.418650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343bd7b-3da1-4143-96fd-dc9f9ad9b425 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:49.436187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 274/558] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:49.437506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343bd7b-3da1-4143-96fd-dc9f9ad9b425 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:49.450331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01a45f-8d94-4d19-a1cf-8870ec969c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:49.452980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01a45f-8d94-4d19-a1cf-8870ec969c70 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:49.455554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:49.559860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343bd7b-3da1-4143-96fd-dc9f9ad9b425 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:49.575800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 285/559] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:49.576972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01a45f-8d94-4d19-a1cf-8870ec969c70 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:49.605846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d67b84-f235-4249-bf6a-2f4c6a937a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:49.606986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d67b84-f235-4249-bf6a-2f4c6a937a0c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:49.607472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d67b84-f235-4249-bf6a-2f4c6a937a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:49.607942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d67b84-f235-4249-bf6a-2f4c6a937a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:49.609083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d67b84-f235-4249-bf6a-2f4c6a937a0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:49.609694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d67b84-f235-4249-bf6a-2f4c6a937a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:49.611391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d67b84-f235-4249-bf6a-2f4c6a937a0c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:49.621064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 275/560] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:49.622151 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d67b84-f235-4249-bf6a-2f4c6a937a0c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:49.655415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:49.701956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:49.716589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01a45f-8d94-4d19-a1cf-8870ec969c70 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:49.740117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d67b84-f235-4249-bf6a-2f4c6a937a0c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:49.766753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a52460-afd1-4623-8ed3-84a1895b21ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:49.767997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a52460-afd1-4623-8ed3-84a1895b21ca None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:49.768284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a52460-afd1-4623-8ed3-84a1895b21ca None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:49.768609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a52460-afd1-4623-8ed3-84a1895b21ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:49.779660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a52460-afd1-4623-8ed3-84a1895b21ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:49.781248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a52460-afd1-4623-8ed3-84a1895b21ca None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:49.782080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031f6b6-c2f8-43c2-bbb1-fbb549778d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:49.783822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031f6b6-c2f8-43c2-bbb1-fbb549778d39 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:49.784233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031f6b6-c2f8-43c2-bbb1-fbb549778d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:49.784730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031f6b6-c2f8-43c2-bbb1-fbb549778d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:49.797054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031f6b6-c2f8-43c2-bbb1-fbb549778d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:49.799054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031f6b6-c2f8-43c2-bbb1-fbb549778d39 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-56a52460-afd1-4623-8ed3-84a1895b21ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:49.799365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:49.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:49.801525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 286/561] 10.222.0.74 () {56 vars in 1093 bytes} [Mon May 23 16:26:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:49.802218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a52460-afd1-4623-8ed3-84a1895b21ca None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-e031f6b6-c2f8-43c2-bbb1-fbb549778d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:49.823211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:49.824144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:49.825378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:49.825378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:49.825378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:49.825378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:49.827530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 276/562] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:49.828622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031f6b6-c2f8-43c2-bbb1-fbb549778d39 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:49.936576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a52460-afd1-4623-8ed3-84a1895b21ca None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:49.944878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031f6b6-c2f8-43c2-bbb1-fbb549778d39 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:49.953421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:49.971402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:49.974756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc053f-09b1-42d0-a934-37c4b19016ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:49.975685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc053f-09b1-42d0-a934-37c4b19016ae None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:49.976485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc053f-09b1-42d0-a934-37c4b19016ae None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:49.976766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc053f-09b1-42d0-a934-37c4b19016ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:49.982871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54b7fb-6ad7-4bdf-955a-a4442f680ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:49.983608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54b7fb-6ad7-4bdf-955a-a4442f680ecc None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:49.983892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54b7fb-6ad7-4bdf-955a-a4442f680ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:49.984168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54b7fb-6ad7-4bdf-955a-a4442f680ecc None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:49.985073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54b7fb-6ad7-4bdf-955a-a4442f680ecc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:49.985386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54b7fb-6ad7-4bdf-955a-a4442f680ecc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:49.986888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54b7fb-6ad7-4bdf-955a-a4442f680ecc None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:49.988505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc053f-09b1-42d0-a934-37c4b19016ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:49.990207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc053f-09b1-42d0-a934-37c4b19016ae None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:50.007019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 277/563] 10.222.0.74 () {56 vars in 1133 bytes} [Mon May 23 16:26:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:50.007757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54b7fb-6ad7-4bdf-955a-a4442f680ecc None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-13fc053f-09b1-42d0-a934-37c4b19016ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:50.011221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:50.012167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:50.013253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:50.013253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:50.013253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:50.013253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:50.015176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 287/564] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:50.016537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbfa5a-3287-4909-a8f5-852a6774d040 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.016827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbfa5a-3287-4909-a8f5-852a6774d040 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.017362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbfa5a-3287-4909-a8f5-852a6774d040 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.018935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 288/565] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:50.019652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbfa5a-3287-4909-a8f5-852a6774d040 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.123307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54b7fb-6ad7-4bdf-955a-a4442f680ecc None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.131274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbfa5a-3287-4909-a8f5-852a6774d040 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.163952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f444fda-3025-425a-a7f7-96e9e9c66aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:50.164645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f444fda-3025-425a-a7f7-96e9e9c66aff None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.164935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f444fda-3025-425a-a7f7-96e9e9c66aff None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.165209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f444fda-3025-425a-a7f7-96e9e9c66aff None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.165937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f444fda-3025-425a-a7f7-96e9e9c66aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:50.166243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f444fda-3025-425a-a7f7-96e9e9c66aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:50.167615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f444fda-3025-425a-a7f7-96e9e9c66aff None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:50.173484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0110f2d-0b71-4673-823c-c74c5cd55e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:50.174567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0110f2d-0b71-4673-823c-c74c5cd55e56 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.175058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0110f2d-0b71-4673-823c-c74c5cd55e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.175529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0110f2d-0b71-4673-823c-c74c5cd55e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.179592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 278/566] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:50.180877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa3774-c535-4bf5-a603-2aa6e3483eba None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.181168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa3774-c535-4bf5-a603-2aa6e3483eba None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.181450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa3774-c535-4bf5-a603-2aa6e3483eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.188328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0110f2d-0b71-4673-823c-c74c5cd55e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:50.189942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0110f2d-0b71-4673-823c-c74c5cd55e56 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:50.201842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8bfa3774-c535-4bf5-a603-2aa6e3483eba None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:50.203067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8bfa3774-c535-4bf5-a603-2aa6e3483eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-a0110f2d-0b71-4673-823c-c74c5cd55e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:50.210357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:50.211253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:50.215270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:50.215270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:50.215270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:50.215270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:50.215270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 289/567] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:50.215270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0110f2d-0b71-4673-823c-c74c5cd55e56 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.237084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:50.245387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:50.293794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 279/568] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:50.293794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa3774-c535-4bf5-a603-2aa6e3483eba None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.324332 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0110f2d-0b71-4673-823c-c74c5cd55e56 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.360063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784bfeb-7a2c-440d-89d4-6ba600be692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:50.360759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bfeb-7a2c-440d-89d4-6ba600be692a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.361043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bfeb-7a2c-440d-89d4-6ba600be692a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.361317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bfeb-7a2c-440d-89d4-6ba600be692a None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.362038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784bfeb-7a2c-440d-89d4-6ba600be692a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:50.362343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784bfeb-7a2c-440d-89d4-6ba600be692a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:50.363726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784bfeb-7a2c-440d-89d4-6ba600be692a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:50.375162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 290/569] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:50.375951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784bfeb-7a2c-440d-89d4-6ba600be692a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.398138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa3774-c535-4bf5-a603-2aa6e3483eba None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.432119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710af21-9e9d-4367-83f4-18a1b2fef223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:50.433055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710af21-9e9d-4367-83f4-18a1b2fef223 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.433341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710af21-9e9d-4367-83f4-18a1b2fef223 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.433615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710af21-9e9d-4367-83f4-18a1b2fef223 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.440093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710af21-9e9d-4367-83f4-18a1b2fef223 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:50.441652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710af21-9e9d-4367-83f4-18a1b2fef223 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:50.453545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-7710af21-9e9d-4367-83f4-18a1b2fef223 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:50.455220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:50.456199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:50.457142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:50.457142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:50.457142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:50.457142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:50.457142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:50.457142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:50.457142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:50.457142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:50.457142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 280/570] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:50.457614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710af21-9e9d-4367-83f4-18a1b2fef223 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.479446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784bfeb-7a2c-440d-89d4-6ba600be692a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.489014 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:50.513553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2ae5d-b1d2-49bf-8910-94a630ebc30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:50.514212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ae5d-b1d2-49bf-8910-94a630ebc30b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.514489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ae5d-b1d2-49bf-8910-94a630ebc30b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.514771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ae5d-b1d2-49bf-8910-94a630ebc30b None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.515490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2ae5d-b1d2-49bf-8910-94a630ebc30b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:50.515794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2ae5d-b1d2-49bf-8910-94a630ebc30b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:50.517451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2ae5d-b1d2-49bf-8910-94a630ebc30b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:50.528966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 291/571] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:50.530194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186a1c-fcb8-4e9a-a961-757e7bfd1c14 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.530478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186a1c-fcb8-4e9a-a961-757e7bfd1c14 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.530752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186a1c-fcb8-4e9a-a961-757e7bfd1c14 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.531978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 292/572] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:50.532694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186a1c-fcb8-4e9a-a961-757e7bfd1c14 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.561094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710af21-9e9d-4367-83f4-18a1b2fef223 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.602111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e4cad-6973-4b0f-ad0f-14f75aefee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:50.602901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e4cad-6973-4b0f-ad0f-14f75aefee3e None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.603181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e4cad-6973-4b0f-ad0f-14f75aefee3e None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.603449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e4cad-6973-4b0f-ad0f-14f75aefee3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.613324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e4cad-6973-4b0f-ad0f-14f75aefee3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-741e4cad-6973-4b0f-ad0f-14f75aefee3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:50.621105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:50.622231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 281/573] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:50.623176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e4cad-6973-4b0f-ad0f-14f75aefee3e None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.641126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186a1c-fcb8-4e9a-a961-757e7bfd1c14 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.675630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4aa7f-d013-4ae0-9dde-91ec165c5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:50.676451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4aa7f-d013-4ae0-9dde-91ec165c5772 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.676733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4aa7f-d013-4ae0-9dde-91ec165c5772 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.677000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4aa7f-d013-4ae0-9dde-91ec165c5772 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.683914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4aa7f-d013-4ae0-9dde-91ec165c5772 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:50.685395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4aa7f-d013-4ae0-9dde-91ec165c5772 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:50.687089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-b8a4aa7f-d013-4ae0-9dde-91ec165c5772 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:50.700373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:50.705409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 293/574] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:50.706594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4aa7f-d013-4ae0-9dde-91ec165c5772 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.715643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:50.724866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e4cad-6973-4b0f-ad0f-14f75aefee3e None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.759362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fde15-0077-4fe7-ae19-32f21f185181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:50.759947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fde15-0077-4fe7-ae19-32f21f185181 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.760229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fde15-0077-4fe7-ae19-32f21f185181 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.760582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fde15-0077-4fe7-ae19-32f21f185181 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.761365 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fde15-0077-4fe7-ae19-32f21f185181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:50.761672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fde15-0077-4fe7-ae19-32f21f185181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:50.763131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fde15-0077-4fe7-ae19-32f21f185181 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:50.775380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 282/575] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:50.776604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e4955-4845-48a5-b038-860ce11abfea None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.776890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e4955-4845-48a5-b038-860ce11abfea None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.777171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e4955-4845-48a5-b038-860ce11abfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.794997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7c7e4955-4845-48a5-b038-860ce11abfea None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:50.796193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7c7e4955-4845-48a5-b038-860ce11abfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:50.807028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4aa7f-d013-4ae0-9dde-91ec165c5772 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.841586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35095b0b-66e3-4ffe-acc7-5e0b7dc71c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:50.842378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35095b0b-66e3-4ffe-acc7-5e0b7dc71c35 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:50.842660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35095b0b-66e3-4ffe-acc7-5e0b7dc71c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:50.842988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35095b0b-66e3-4ffe-acc7-5e0b7dc71c35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:50.850031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35095b0b-66e3-4ffe-acc7-5e0b7dc71c35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:50.851471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35095b0b-66e3-4ffe-acc7-5e0b7dc71c35 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:50.861599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 283/576] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:50.862434 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e4955-4845-48a5-b038-860ce11abfea None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-35095b0b-66e3-4ffe-acc7-5e0b7dc71c35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:50.865609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:50.866743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 294/577] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:50.867662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35095b0b-66e3-4ffe-acc7-5e0b7dc71c35 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:50.935927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:50.953350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:50.970995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e4955-4845-48a5-b038-860ce11abfea None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:50.977844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35095b0b-66e3-4ffe-acc7-5e0b7dc71c35 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.005013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82f4c9-32b2-4a32-93b2-537251bb5cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.006551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82f4c9-32b2-4a32-93b2-537251bb5cab None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.007012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82f4c9-32b2-4a32-93b2-537251bb5cab None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.007299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82f4c9-32b2-4a32-93b2-537251bb5cab None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.008050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82f4c9-32b2-4a32-93b2-537251bb5cab None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:51.008390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82f4c9-32b2-4a32-93b2-537251bb5cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.009833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82f4c9-32b2-4a32-93b2-537251bb5cab None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.011880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1968c-c02c-46cc-8b15-8877166c430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.012580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1968c-c02c-46cc-8b15-8877166c430b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.012865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1968c-c02c-46cc-8b15-8877166c430b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.013145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1968c-c02c-46cc-8b15-8877166c430b None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.013981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1968c-c02c-46cc-8b15-8877166c430b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:51.014294 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1968c-c02c-46cc-8b15-8877166c430b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.015718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1968c-c02c-46cc-8b15-8877166c430b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.018084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 284/578] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:51.018939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82f4c9-32b2-4a32-93b2-537251bb5cab None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.034608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 295/579] 10.222.0.74 () {56 vars in 1137 bytes} [Mon May 23 16:26:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:51.035429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1968c-c02c-46cc-8b15-8877166c430b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.119547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82f4c9-32b2-4a32-93b2-537251bb5cab None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.137382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1968c-c02c-46cc-8b15-8877166c430b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.152139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409198f-dec5-4727-a9e7-ecbba605f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.152825 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409198f-dec5-4727-a9e7-ecbba605f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.153112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409198f-dec5-4727-a9e7-ecbba605f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.153385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409198f-dec5-4727-a9e7-ecbba605f4a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.154211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409198f-dec5-4727-a9e7-ecbba605f4a3 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=45f676694ec24de2a5c755e217baed87) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:51.154346 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:51.154517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409198f-dec5-4727-a9e7-ecbba605f4a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.155944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409198f-dec5-4727-a9e7-ecbba605f4a3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.172633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 285/580] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/role_assignments?user.id=45f676694ec24de2a5c755e217baed87&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:51.172633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409198f-dec5-4727-a9e7-ecbba605f4a3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.172917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50b63b-a871-4c33-beb2-f25468f4422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.172917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50b63b-a871-4c33-beb2-f25468f4422b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.173096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50b63b-a871-4c33-beb2-f25468f4422b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.177974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50b63b-a871-4c33-beb2-f25468f4422b None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.177974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50b63b-a871-4c33-beb2-f25468f4422b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:51.177974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50b63b-a871-4c33-beb2-f25468f4422b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.177974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50b63b-a871-4c33-beb2-f25468f4422b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.187894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:51.192484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 296/581] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:51.197207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50b63b-a871-4c33-beb2-f25468f4422b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.310328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409198f-dec5-4727-a9e7-ecbba605f4a3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.320987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50b63b-a871-4c33-beb2-f25468f4422b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.348474 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e4f5d-a087-4fe4-bdf2-6ce553c374bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.349448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e4f5d-a087-4fe4-bdf2-6ce553c374bd None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.349783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e4f5d-a087-4fe4-bdf2-6ce553c374bd None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.350073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e4f5d-a087-4fe4-bdf2-6ce553c374bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.359773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235ed3a-966d-487c-8d00-352c97f1cb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.360670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ed3a-966d-487c-8d00-352c97f1cb17 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.360962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ed3a-966d-487c-8d00-352c97f1cb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.361246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ed3a-966d-487c-8d00-352c97f1cb17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.361693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e4f5d-a087-4fe4-bdf2-6ce553c374bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-2c9e4f5d-a087-4fe4-bdf2-6ce553c374bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:51.369464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:51.370400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 286/582] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:51.371840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e4f5d-a087-4fe4-bdf2-6ce553c374bd None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.378177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235ed3a-966d-487c-8d00-352c97f1cb17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.379764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235ed3a-966d-487c-8d00-352c97f1cb17 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-e235ed3a-966d-487c-8d00-352c97f1cb17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:51.401511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:51.402634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:51.403734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:51.403734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:51.403734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:51.403734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:51.404568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 297/583] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:51.405258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235ed3a-966d-487c-8d00-352c97f1cb17 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.437406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:51.451368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:51.486666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e4f5d-a087-4fe4-bdf2-6ce553c374bd None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.513044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235ed3a-966d-487c-8d00-352c97f1cb17 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.529209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b8fd-b1a7-47cc-b4f6-bd6b05d2c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.530112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b8fd-b1a7-47cc-b4f6-bd6b05d2c675 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.530406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b8fd-b1a7-47cc-b4f6-bd6b05d2c675 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.530688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b8fd-b1a7-47cc-b4f6-bd6b05d2c675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.543444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b8fd-b1a7-47cc-b4f6-bd6b05d2c675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.544962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b8fd-b1a7-47cc-b4f6-bd6b05d2c675 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.556336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9791-a1a3-4646-b636-8dd787542bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.558730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9791-a1a3-4646-b636-8dd787542bae None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.558730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9791-a1a3-4646-b636-8dd787542bae None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.558730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9791-a1a3-4646-b636-8dd787542bae None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/951eca3289634609bcb684181e147ca3/roles/e521dfb490db4640aa9c1390bf4e209e` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-8611b8fd-b1a7-47cc-b4f6-bd6b05d2c675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:51.562622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:51.563489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:51.570137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:51.570137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:51.570137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:51.570137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:51.570137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 287/584] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:51.570137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b8fd-b1a7-47cc-b4f6-bd6b05d2c675 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.576228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca9791-a1a3-4646-b636-8dd787542bae None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=951eca3289634609bcb684181e147ca3, role_id=e521dfb490db4640aa9c1390bf4e209e)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.577725 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca9791-a1a3-4646-b636-8dd787542bae None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.639376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 298/585] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:26:51 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/951eca3289634609bcb684181e147ca3/roles/e521dfb490db4640aa9c1390bf4e209e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:51.640065 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9791-a1a3-4646-b636-8dd787542bae None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.713821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b8fd-b1a7-47cc-b4f6-bd6b05d2c675 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.753399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:51.758518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:51.778143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84dcf1-f2bc-45d8-b6f4-0d3700c7798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.778832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84dcf1-f2bc-45d8-b6f4-0d3700c7798c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.779116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84dcf1-f2bc-45d8-b6f4-0d3700c7798c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.779389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84dcf1-f2bc-45d8-b6f4-0d3700c7798c None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.779850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9791-a1a3-4646-b636-8dd787542bae None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.780192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84dcf1-f2bc-45d8-b6f4-0d3700c7798c None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:51.780533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84dcf1-f2bc-45d8-b6f4-0d3700c7798c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.783640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84dcf1-f2bc-45d8-b6f4-0d3700c7798c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.792495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 288/586] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:51.793454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84dcf1-f2bc-45d8-b6f4-0d3700c7798c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.824765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff5d6-9d64-426d-8e98-a57e8e1effc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.825607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff5d6-9d64-426d-8e98-a57e8e1effc1 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.826376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff5d6-9d64-426d-8e98-a57e8e1effc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.826783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff5d6-9d64-426d-8e98-a57e8e1effc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.827626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff5d6-9d64-426d-8e98-a57e8e1effc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:51.828036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff5d6-9d64-426d-8e98-a57e8e1effc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.829661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff5d6-9d64-426d-8e98-a57e8e1effc1 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.843213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 299/587] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:51.844269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff5d6-9d64-426d-8e98-a57e8e1effc1 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.918999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84dcf1-f2bc-45d8-b6f4-0d3700c7798c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:51.954710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ba00b-794a-41b0-b9c9-62746c3ff091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:51.955378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ba00b-794a-41b0-b9c9-62746c3ff091 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:51.955862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ba00b-794a-41b0-b9c9-62746c3ff091 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:51.955980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ba00b-794a-41b0-b9c9-62746c3ff091 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:51.956685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ba00b-794a-41b0-b9c9-62746c3ff091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:51.957008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ba00b-794a-41b0-b9c9-62746c3ff091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:51.958373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ba00b-794a-41b0-b9c9-62746c3ff091 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:51.976575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 289/588] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:51.977605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ba00b-794a-41b0-b9c9-62746c3ff091 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:51.983965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff5d6-9d64-426d-8e98-a57e8e1effc1 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.029299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:52.032882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39c934-8634-4cc5-bec9-4c457259b604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.034219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39c934-8634-4cc5-bec9-4c457259b604 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.034650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39c934-8634-4cc5-bec9-4c457259b604 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.035312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39c934-8634-4cc5-bec9-4c457259b604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.044127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:52.050673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39c934-8634-4cc5-bec9-4c457259b604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.052431 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39c934-8634-4cc5-bec9-4c457259b604 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-2f39c934-8634-4cc5-bec9-4c457259b604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:52.078501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:52.079618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:52.080779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:52.080779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:52.080779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:52.080779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:52.083214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 300/589] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:52.085046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39c934-8634-4cc5-bec9-4c457259b604 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.105320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ba00b-794a-41b0-b9c9-62746c3ff091 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.152200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597a900-bd9d-4611-bb19-35e57f54f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.153442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597a900-bd9d-4611-bb19-35e57f54f7bf None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.154105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597a900-bd9d-4611-bb19-35e57f54f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.154384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597a900-bd9d-4611-bb19-35e57f54f7bf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.164629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597a900-bd9d-4611-bb19-35e57f54f7bf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.166967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597a900-bd9d-4611-bb19-35e57f54f7bf None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-4597a900-bd9d-4611-bb19-35e57f54f7bf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:52.186500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:52.187622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:52.188619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 290/590] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:52.194678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597a900-bd9d-4611-bb19-35e57f54f7bf None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.209395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39c934-8634-4cc5-bec9-4c457259b604 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.253119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d7422-8495-4c68-bbb1-804a112e3e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.253927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d7422-8495-4c68-bbb1-804a112e3e5d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.254274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d7422-8495-4c68-bbb1-804a112e3e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.254550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d7422-8495-4c68-bbb1-804a112e3e5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.262164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d7422-8495-4c68-bbb1-804a112e3e5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.263629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d7422-8495-4c68-bbb1-804a112e3e5d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-e26d7422-8495-4c68-bbb1-804a112e3e5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:52.278878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:52.279802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:52.280771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:52.280771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:52.280771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:52.280771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:52.280771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:52.280771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:52.280771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:52.280771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:52.280771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 301/591] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:52.285485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d7422-8495-4c68-bbb1-804a112e3e5d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.306000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597a900-bd9d-4611-bb19-35e57f54f7bf None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.307729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:52.341137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:52.342986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec156-3a75-4d8a-912e-4dbea6ea957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.343654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec156-3a75-4d8a-912e-4dbea6ea957e None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.343934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec156-3a75-4d8a-912e-4dbea6ea957e None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.344210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec156-3a75-4d8a-912e-4dbea6ea957e None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.345234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec156-3a75-4d8a-912e-4dbea6ea957e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:52.345588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec156-3a75-4d8a-912e-4dbea6ea957e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.347502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec156-3a75-4d8a-912e-4dbea6ea957e None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.364479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 291/592] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:52.365935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec156-3a75-4d8a-912e-4dbea6ea957e None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.397713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d7422-8495-4c68-bbb1-804a112e3e5d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.434869 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e935e-843e-45d6-9f8e-b79e26ecabcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.435824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e935e-843e-45d6-9f8e-b79e26ecabcb None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.436254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e935e-843e-45d6-9f8e-b79e26ecabcb None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.436699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e935e-843e-45d6-9f8e-b79e26ecabcb None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.437684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e935e-843e-45d6-9f8e-b79e26ecabcb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:52.438157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e935e-843e-45d6-9f8e-b79e26ecabcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.439857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e935e-843e-45d6-9f8e-b79e26ecabcb None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.458910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 302/593] 10.222.0.74 () {56 vars in 1137 bytes} [Mon May 23 16:26:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:52.460189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e935e-843e-45d6-9f8e-b79e26ecabcb None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.473077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec156-3a75-4d8a-912e-4dbea6ea957e None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.508997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f32a2-d0e1-4648-9ca9-d7ae5c67d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.509701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f32a2-d0e1-4648-9ca9-d7ae5c67d071 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.509985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f32a2-d0e1-4648-9ca9-d7ae5c67d071 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.510309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f32a2-d0e1-4648-9ca9-d7ae5c67d071 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.511131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f32a2-d0e1-4648-9ca9-d7ae5c67d071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:52.511445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f32a2-d0e1-4648-9ca9-d7ae5c67d071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.512967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f32a2-d0e1-4648-9ca9-d7ae5c67d071 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.530736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 292/594] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:52.531623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f32a2-d0e1-4648-9ca9-d7ae5c67d071 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.561763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:52.571040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e935e-843e-45d6-9f8e-b79e26ecabcb None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.581267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:52.608129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955107c3-1e40-422f-9c19-d1b493320bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.609272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955107c3-1e40-422f-9c19-d1b493320bfc None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.609794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955107c3-1e40-422f-9c19-d1b493320bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.610268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955107c3-1e40-422f-9c19-d1b493320bfc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.618488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955107c3-1e40-422f-9c19-d1b493320bfc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.620177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955107c3-1e40-422f-9c19-d1b493320bfc None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-955107c3-1e40-422f-9c19-d1b493320bfc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:52.636722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:52.637682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:26:52.638609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:52.641328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 303/595] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:52.642545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955107c3-1e40-422f-9c19-d1b493320bfc None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.645390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f32a2-d0e1-4648-9ca9-d7ae5c67d071 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.689013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b8da-23b9-40a2-952e-50d861661b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.690158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b8da-23b9-40a2-952e-50d861661b00 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.690644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b8da-23b9-40a2-952e-50d861661b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.691146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b8da-23b9-40a2-952e-50d861661b00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.703578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8b8da-23b9-40a2-952e-50d861661b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.705522 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8b8da-23b9-40a2-952e-50d861661b00 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-88c8b8da-23b9-40a2-952e-50d861661b00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:52.724783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:52.725729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:52.726602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:52.726602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:52.726602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:52.726602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:52.728882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 293/596] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:52.730261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b8da-23b9-40a2-952e-50d861661b00 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.778555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955107c3-1e40-422f-9c19-d1b493320bfc None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.816483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646628d-c4eb-4c6a-948f-0059814e3cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.817756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646628d-c4eb-4c6a-948f-0059814e3cd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.818944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646628d-c4eb-4c6a-948f-0059814e3cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.819482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646628d-c4eb-4c6a-948f-0059814e3cd3 None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/e9533e8371e64161a4c54eeab867a17e/roles/e521dfb490db4640aa9c1390bf4e209e` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.819854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:52.835528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646628d-c4eb-4c6a-948f-0059814e3cd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=e9533e8371e64161a4c54eeab867a17e, role_id=e521dfb490db4640aa9c1390bf4e209e)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.837361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646628d-c4eb-4c6a-948f-0059814e3cd3 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.848698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b8da-23b9-40a2-952e-50d861661b00 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:52.891720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 304/597] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:26:52 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/e9533e8371e64161a4c54eeab867a17e/roles/e521dfb490db4640aa9c1390bf4e209e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:52.893340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646628d-c4eb-4c6a-948f-0059814e3cd3 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.902318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6844dd-ae44-4d1c-a577-d0876d0c20a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:52.902318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6844dd-ae44-4d1c-a577-d0876d0c20a7 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:52.902318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6844dd-ae44-4d1c-a577-d0876d0c20a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:52.902318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6844dd-ae44-4d1c-a577-d0876d0c20a7 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:52.902765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6844dd-ae44-4d1c-a577-d0876d0c20a7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:52.902765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6844dd-ae44-4d1c-a577-d0876d0c20a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:52.905606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6844dd-ae44-4d1c-a577-d0876d0c20a7 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:52.930677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 294/598] 10.222.0.74 () {56 vars in 1139 bytes} [Mon May 23 16:26:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:52.936450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6844dd-ae44-4d1c-a577-d0876d0c20a7 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:52.942260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:53.071000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6844dd-ae44-4d1c-a577-d0876d0c20a7 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:53.107218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:53.113109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeeca7-a2bd-44f8-96d9-db94f9e79df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:53.114140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeeca7-a2bd-44f8-96d9-db94f9e79df9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.114566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeeca7-a2bd-44f8-96d9-db94f9e79df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.116106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeeca7-a2bd-44f8-96d9-db94f9e79df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.129150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbeeca7-a2bd-44f8-96d9-db94f9e79df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:53.131981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbeeca7-a2bd-44f8-96d9-db94f9e79df9 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-6bbeeca7-a2bd-44f8-96d9-db94f9e79df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:53.155170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:53.156254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:53.157337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:53.157337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:53.157337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:53.157337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:53.159881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 295/599] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:53.167089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeeca7-a2bd-44f8-96d9-db94f9e79df9 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:53.179364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646628d-c4eb-4c6a-948f-0059814e3cd3 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:53.236921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa23d98-31eb-4c74-b194-30bb53cd2e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:53.237599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa23d98-31eb-4c74-b194-30bb53cd2e4e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.237880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa23d98-31eb-4c74-b194-30bb53cd2e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.238151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa23d98-31eb-4c74-b194-30bb53cd2e4e None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.238936 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa23d98-31eb-4c74-b194-30bb53cd2e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:53.239244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa23d98-31eb-4c74-b194-30bb53cd2e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:53.243301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa23d98-31eb-4c74-b194-30bb53cd2e4e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:53.258445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 305/600] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:53.263523 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa23d98-31eb-4c74-b194-30bb53cd2e4e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:53.302919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeeca7-a2bd-44f8-96d9-db94f9e79df9 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:53.348739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ea63f-db1a-43ea-b921-69de5113082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:53.350124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea63f-db1a-43ea-b921-69de5113082d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.350458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea63f-db1a-43ea-b921-69de5113082d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.350729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea63f-db1a-43ea-b921-69de5113082d None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.351462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ea63f-db1a-43ea-b921-69de5113082d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:53.351763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ea63f-db1a-43ea-b921-69de5113082d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:53.353658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ea63f-db1a-43ea-b921-69de5113082d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:53.355665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:53.369428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 296/601] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:53.376574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ea63f-db1a-43ea-b921-69de5113082d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:53.388510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa23d98-31eb-4c74-b194-30bb53cd2e4e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:53.431749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:53.467438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986dd59-5bdd-4463-bd35-1784269ec67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:53.468255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986dd59-5bdd-4463-bd35-1784269ec67c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.468563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986dd59-5bdd-4463-bd35-1784269ec67c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.468837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986dd59-5bdd-4463-bd35-1784269ec67c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.476477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986dd59-5bdd-4463-bd35-1784269ec67c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:53.477927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986dd59-5bdd-4463-bd35-1784269ec67c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:53.492790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ea63f-db1a-43ea-b921-69de5113082d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-d986dd59-5bdd-4463-bd35-1784269ec67c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:53.500587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:53.502622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:53.504793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:53.504793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:53.504793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:53.504793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:53.504793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:53.504793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:53.504793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:53.504793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:53.506450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 306/602] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:53.508329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986dd59-5bdd-4463-bd35-1784269ec67c None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:53.529257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982105ed-a957-439f-ab5a-bf4959377182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:53.530371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982105ed-a957-439f-ab5a-bf4959377182 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.530657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982105ed-a957-439f-ab5a-bf4959377182 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.531074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982105ed-a957-439f-ab5a-bf4959377182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.539628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982105ed-a957-439f-ab5a-bf4959377182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:53.546072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982105ed-a957-439f-ab5a-bf4959377182 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-982105ed-a957-439f-ab5a-bf4959377182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:53.557788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:53.559552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 297/603] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093d2f7-95dd-4c85-b901-65d1cb6e05a9 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.561742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093d2f7-95dd-4c85-b901-65d1cb6e05a9 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.563325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093d2f7-95dd-4c85-b901-65d1cb6e05a9 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.563325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 298/604] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:53.567011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093d2f7-95dd-4c85-b901-65d1cb6e05a9 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:53.649188 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986dd59-5bdd-4463-bd35-1784269ec67c None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:53.690778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964b7d-02ed-4838-91d5-d55bf0170de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:53.691886 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964b7d-02ed-4838-91d5-d55bf0170de1 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.692674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964b7d-02ed-4838-91d5-d55bf0170de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.694118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964b7d-02ed-4838-91d5-d55bf0170de1 None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.695273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be964b7d-02ed-4838-91d5-d55bf0170de1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:53.696142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be964b7d-02ed-4838-91d5-d55bf0170de1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:53.698081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be964b7d-02ed-4838-91d5-d55bf0170de1 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:53.699472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093d2f7-95dd-4c85-b901-65d1cb6e05a9 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:53.702506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:53.716334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 307/605] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:53.716334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9f8c6-1ddf-410f-9d20-b99d6d3267e9 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.716334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9f8c6-1ddf-410f-9d20-b99d6d3267e9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.716334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9f8c6-1ddf-410f-9d20-b99d6d3267e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.717280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:53.736117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9fe9f8c6-1ddf-410f-9d20-b99d6d3267e9 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:53.737640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9fe9f8c6-1ddf-410f-9d20-b99d6d3267e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:53.745317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cba3c3-2f0b-43e0-aa2e-d3ea7d85b2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:53.746694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba3c3-2f0b-43e0-aa2e-d3ea7d85b2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.747177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba3c3-2f0b-43e0-aa2e-d3ea7d85b2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.747624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba3c3-2f0b-43e0-aa2e-d3ea7d85b2f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.748979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cba3c3-2f0b-43e0-aa2e-d3ea7d85b2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:53.749830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cba3c3-2f0b-43e0-aa2e-d3ea7d85b2f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:53.751963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cba3c3-2f0b-43e0-aa2e-d3ea7d85b2f3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:53.770336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 299/606] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:53.772128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cba3c3-2f0b-43e0-aa2e-d3ea7d85b2f3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:53.824577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 308/607] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:53.825447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9f8c6-1ddf-410f-9d20-b99d6d3267e9 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:53.908136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cba3c3-2f0b-43e0-aa2e-d3ea7d85b2f3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:53.950671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9f8c6-1ddf-410f-9d20-b99d6d3267e9 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:53.955618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21560bee-ff17-4333-af2b-b5443260e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:53.956547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21560bee-ff17-4333-af2b-b5443260e046 None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.956832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21560bee-ff17-4333-af2b-b5443260e046 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.957103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21560bee-ff17-4333-af2b-b5443260e046 None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/6d377792af1c4ad19519e2e98bac72e5/roles/e521dfb490db4640aa9c1390bf4e209e` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:53.978683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21560bee-ff17-4333-af2b-b5443260e046 None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=6d377792af1c4ad19519e2e98bac72e5, role_id=e521dfb490db4640aa9c1390bf4e209e)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:53.980416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:53.981186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21560bee-ff17-4333-af2b-b5443260e046 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:53.992927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22103-37a5-4d6d-8917-c38080dd6394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:53.994100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22103-37a5-4d6d-8917-c38080dd6394 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:53.994529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22103-37a5-4d6d-8917-c38080dd6394 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:53.994980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22103-37a5-4d6d-8917-c38080dd6394 None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/a833149a66af4452aeedd5d43f2fb2eb/roles/e521dfb490db4640aa9c1390bf4e209e` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:54.012037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d22103-37a5-4d6d-8917-c38080dd6394 None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=a833149a66af4452aeedd5d43f2fb2eb, role_id=e521dfb490db4640aa9c1390bf4e209e)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:54.014323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d22103-37a5-4d6d-8917-c38080dd6394 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:54.069390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 300/608] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:26:53 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/6d377792af1c4ad19519e2e98bac72e5/roles/e521dfb490db4640aa9c1390bf4e209e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:54.070228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21560bee-ff17-4333-af2b-b5443260e046 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:54.092050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:54.102030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 309/609] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:26:53 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/a833149a66af4452aeedd5d43f2fb2eb/roles/e521dfb490db4640aa9c1390bf4e209e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:54.102030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420bb4-818b-4924-bd12-7204721cabac None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:54.102328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420bb4-818b-4924-bd12-7204721cabac None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:54.102406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420bb4-818b-4924-bd12-7204721cabac None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:54.107930 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 310/610] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:54.129943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840f6b-82dd-434d-9af9-39c7701d6159 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:54.130362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840f6b-82dd-434d-9af9-39c7701d6159 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:54.131109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840f6b-82dd-434d-9af9-39c7701d6159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:54.173756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a3840f6b-82dd-434d-9af9-39c7701d6159 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:54.175005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a3840f6b-82dd-434d-9af9-39c7701d6159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:54.231884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21560bee-ff17-4333-af2b-b5443260e046 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:54.315682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1892836-9d52-46c4-9475-6a92490ea86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:54.316643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1892836-9d52-46c4-9475-6a92490ea86d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:54.316932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1892836-9d52-46c4-9475-6a92490ea86d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:54.317210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1892836-9d52-46c4-9475-6a92490ea86d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:54.326207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 311/611] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:54.332946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1892836-9d52-46c4-9475-6a92490ea86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-d1892836-9d52-46c4-9475-6a92490ea86d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:54.341571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:54.342589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:54.343426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 301/612] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:54.349179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3840f6b-82dd-434d-9af9-39c7701d6159 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:54.355936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1892836-9d52-46c4-9475-6a92490ea86d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:54.457082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:54.462158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3840f6b-82dd-434d-9af9-39c7701d6159 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:54.478805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:54.485861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1892836-9d52-46c4-9475-6a92490ea86d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:54.498314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b111df5-4fe2-4ddb-af7a-a9e03dcd93e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:54.498992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b111df5-4fe2-4ddb-af7a-a9e03dcd93e8 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:54.499274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b111df5-4fe2-4ddb-af7a-a9e03dcd93e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:54.499545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b111df5-4fe2-4ddb-af7a-a9e03dcd93e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:54.500289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b111df5-4fe2-4ddb-af7a-a9e03dcd93e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:54.501773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b111df5-4fe2-4ddb-af7a-a9e03dcd93e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:54.502166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b111df5-4fe2-4ddb-af7a-a9e03dcd93e8 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:54.518879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 312/613] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:54.524760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b111df5-4fe2-4ddb-af7a-a9e03dcd93e8 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:54.556204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98142a-6b0d-4ce0-a2d9-d5d7558f35f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:54.557029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98142a-6b0d-4ce0-a2d9-d5d7558f35f2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:54.557309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98142a-6b0d-4ce0-a2d9-d5d7558f35f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:54.557579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98142a-6b0d-4ce0-a2d9-d5d7558f35f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:54.573489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98142a-6b0d-4ce0-a2d9-d5d7558f35f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-0e98142a-6b0d-4ce0-a2d9-d5d7558f35f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:54.581241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:54.582171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:54.583022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:54.585295 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 302/614] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:54.594319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98142a-6b0d-4ce0-a2d9-d5d7558f35f2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:54.700125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b111df5-4fe2-4ddb-af7a-a9e03dcd93e8 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:54.729671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98142a-6b0d-4ce0-a2d9-d5d7558f35f2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:54.768696 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52615-6fef-4a91-8183-10b9ca68cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:54.769492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52615-6fef-4a91-8183-10b9ca68cd4d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:54.769767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52615-6fef-4a91-8183-10b9ca68cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:54.770039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52615-6fef-4a91-8183-10b9ca68cd4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:54.787514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d52615-6fef-4a91-8183-10b9ca68cd4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:54.789011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d52615-6fef-4a91-8183-10b9ca68cd4d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:54.800075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f45ee-2593-4c2f-9e9b-825750ea360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:54.800780 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f45ee-2593-4c2f-9e9b-825750ea360f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:54.801061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f45ee-2593-4c2f-9e9b-825750ea360f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:54.801332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f45ee-2593-4c2f-9e9b-825750ea360f None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:54.802626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f45ee-2593-4c2f-9e9b-825750ea360f None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:54.802935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f45ee-2593-4c2f-9e9b-825750ea360f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:54.804322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f45ee-2593-4c2f-9e9b-825750ea360f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:54.806089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-53d52615-6fef-4a91-8183-10b9ca68cd4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:54.817495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:54.823066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:54.824165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:54.824165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:54.824165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:54.824165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:54.824165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 313/615] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:54.824917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52615-6fef-4a91-8183-10b9ca68cd4d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:54.825340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 303/616] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:54.827534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f45ee-2593-4c2f-9e9b-825750ea360f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:54.851376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:54.989352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f45ee-2593-4c2f-9e9b-825750ea360f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:54.998109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52615-6fef-4a91-8183-10b9ca68cd4d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:55.057719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bac1e-2809-4de6-9bb8-cd295aaac0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:55.058512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bac1e-2809-4de6-9bb8-cd295aaac0ba None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.058793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bac1e-2809-4de6-9bb8-cd295aaac0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.059067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bac1e-2809-4de6-9bb8-cd295aaac0ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.067529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45528d08-dcad-407d-a77d-02a77397d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:55.068908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45528d08-dcad-407d-a77d-02a77397d097 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.069185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45528d08-dcad-407d-a77d-02a77397d097 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.069454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45528d08-dcad-407d-a77d-02a77397d097 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.070184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45528d08-dcad-407d-a77d-02a77397d097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:55.070481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45528d08-dcad-407d-a77d-02a77397d097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:55.071878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45528d08-dcad-407d-a77d-02a77397d097 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:55.083047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bac1e-2809-4de6-9bb8-cd295aaac0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:55.085224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bac1e-2809-4de6-9bb8-cd295aaac0ba None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:55.093126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 314/617] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:55.098405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45528d08-dcad-407d-a77d-02a77397d097 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-e90bac1e-2809-4de6-9bb8-cd295aaac0ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:55.110574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:55.111824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:55.112913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:55.112913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:55.112913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:55.112913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:55.116486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 304/618] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:55.117701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bac1e-2809-4de6-9bb8-cd295aaac0ba None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:55.170511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:55.231896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bac1e-2809-4de6-9bb8-cd295aaac0ba None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:55.268131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:55.272349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0bb4-3eea-4862-81a6-0c9707db4e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:55.272349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0bb4-3eea-4862-81a6-0c9707db4e3d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.272349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0bb4-3eea-4862-81a6-0c9707db4e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.272349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0bb4-3eea-4862-81a6-0c9707db4e3d None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.272749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0bb4-3eea-4862-81a6-0c9707db4e3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:55.272749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0bb4-3eea-4862-81a6-0c9707db4e3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:55.273133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0bb4-3eea-4862-81a6-0c9707db4e3d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:55.291045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 305/619] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:55.292318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0bb4-3eea-4862-81a6-0c9707db4e3d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:55.301388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45528d08-dcad-407d-a77d-02a77397d097 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:55.363814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d70e1c-aff5-4ddd-b0a0-7244ecdd46e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:55.365163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d70e1c-aff5-4ddd-b0a0-7244ecdd46e9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.366605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d70e1c-aff5-4ddd-b0a0-7244ecdd46e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.366605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d70e1c-aff5-4ddd-b0a0-7244ecdd46e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.385113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d70e1c-aff5-4ddd-b0a0-7244ecdd46e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:55.386579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d70e1c-aff5-4ddd-b0a0-7244ecdd46e9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:55.402943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0bb4-3eea-4862-81a6-0c9707db4e3d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:55.412809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-59d70e1c-aff5-4ddd-b0a0-7244ecdd46e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:55.413127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:55.414061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:26:55.415052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:55.424684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 315/620] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:26:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:55.430720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d70e1c-aff5-4ddd-b0a0-7244ecdd46e9 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:55.445845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e9d32-b572-41b7-952c-cb9d8bbd34ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:55.447044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e9d32-b572-41b7-952c-cb9d8bbd34ad None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.447554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e9d32-b572-41b7-952c-cb9d8bbd34ad None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.448033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e9d32-b572-41b7-952c-cb9d8bbd34ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.456251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e9d32-b572-41b7-952c-cb9d8bbd34ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:55.459507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e9d32-b572-41b7-952c-cb9d8bbd34ad None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-326e9d32-b572-41b7-952c-cb9d8bbd34ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:55.474350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:55.475330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:26:55.476283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:55.483117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 306/621] 10.222.0.74 () {56 vars in 1093 bytes} [Mon May 23 16:26:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:26:55.484575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e9d32-b572-41b7-952c-cb9d8bbd34ad None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:55.597566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e9d32-b572-41b7-952c-cb9d8bbd34ad None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:55.636517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173fb34-b7b4-4954-8dc8-c8249940cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:55.637594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173fb34-b7b4-4954-8dc8-c8249940cd6f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.638099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173fb34-b7b4-4954-8dc8-c8249940cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.638442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d70e1c-aff5-4ddd-b0a0-7244ecdd46e9 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:55.638817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173fb34-b7b4-4954-8dc8-c8249940cd6f None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.639973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173fb34-b7b4-4954-8dc8-c8249940cd6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:55.640530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173fb34-b7b4-4954-8dc8-c8249940cd6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:55.642454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173fb34-b7b4-4954-8dc8-c8249940cd6f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:55.666558 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 307/622] 10.222.0.74 () {56 vars in 1133 bytes} [Mon May 23 16:26:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:55.668219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173fb34-b7b4-4954-8dc8-c8249940cd6f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:55.698543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:55.712953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb3a32-2963-4dd3-a334-a99c4342c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:55.722241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb3a32-2963-4dd3-a334-a99c4342c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.722241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb3a32-2963-4dd3-a334-a99c4342c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.722241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb3a32-2963-4dd3-a334-a99c4342c5b0 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.722241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb3a32-2963-4dd3-a334-a99c4342c5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:55.722241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb3a32-2963-4dd3-a334-a99c4342c5b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:55.722241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb3a32-2963-4dd3-a334-a99c4342c5b0 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:55.741134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:55.749728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 316/623] 10.222.0.74 () {56 vars in 1135 bytes} [Mon May 23 16:26:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:55.749728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a41a2-41e8-4dec-9240-c714872ef429 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.749728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a41a2-41e8-4dec-9240-c714872ef429 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.749728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a41a2-41e8-4dec-9240-c714872ef429 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.749728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 317/624] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:55.757219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a41a2-41e8-4dec-9240-c714872ef429 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:55.797209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173fb34-b7b4-4954-8dc8-c8249940cd6f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:55.836948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376fd3-f5a4-4b26-bf77-a7abea178f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:55.837787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376fd3-f5a4-4b26-bf77-a7abea178f8f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.838176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376fd3-f5a4-4b26-bf77-a7abea178f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.838567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376fd3-f5a4-4b26-bf77-a7abea178f8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.867923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a41a2-41e8-4dec-9240-c714872ef429 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:55.904756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc483711-6a6f-4dc7-83cd-ab3c14983c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:55.905925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc483711-6a6f-4dc7-83cd-ab3c14983c4b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.906402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc483711-6a6f-4dc7-83cd-ab3c14983c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.906894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc483711-6a6f-4dc7-83cd-ab3c14983c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.916130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376fd3-f5a4-4b26-bf77-a7abea178f8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:55.917889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376fd3-f5a4-4b26-bf77-a7abea178f8f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:55.919144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc483711-6a6f-4dc7-83cd-ab3c14983c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:55.920900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc483711-6a6f-4dc7-83cd-ab3c14983c4b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-fc483711-6a6f-4dc7-83cd-ab3c14983c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:55.939752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:55.940713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:55.941599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:55.941599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:55.941599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:55.941599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:55.947315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:55.948707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 318/625] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:55.950021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2adb-d25d-45be-be7c-29594684e520 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:55.950314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2adb-d25d-45be-be7c-29594684e520 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:55.950633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2adb-d25d-45be-be7c-29594684e520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:55.968417 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-375e2adb-d25d-45be-be7c-29594684e520 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:55.969622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-375e2adb-d25d-45be-be7c-29594684e520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:56.022415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:56.034481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 308/626] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:56.035938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376fd3-f5a4-4b26-bf77-a7abea178f8f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.048002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 319/627] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:56.052556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2adb-d25d-45be-be7c-29594684e520 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.154632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2adb-d25d-45be-be7c-29594684e520 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:56.175797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376fd3-f5a4-4b26-bf77-a7abea178f8f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:56.190502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d619d-2a18-4938-859a-0b7bdb70f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:56.191403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d619d-2a18-4938-859a-0b7bdb70f8dd None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.191770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d619d-2a18-4938-859a-0b7bdb70f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.192051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d619d-2a18-4938-859a-0b7bdb70f8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.203671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d619d-2a18-4938-859a-0b7bdb70f8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:56.205348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d619d-2a18-4938-859a-0b7bdb70f8dd None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:56.207599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:56.219212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d347f4a-7d9f-4073-9f24-5f5168b2bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:56.220114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d347f4a-7d9f-4073-9f24-5f5168b2bafe None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.220621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d347f4a-7d9f-4073-9f24-5f5168b2bafe None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.221095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d347f4a-7d9f-4073-9f24-5f5168b2bafe None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.222019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d347f4a-7d9f-4073-9f24-5f5168b2bafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:56.222506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d347f4a-7d9f-4073-9f24-5f5168b2bafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:56.224153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d347f4a-7d9f-4073-9f24-5f5168b2bafe None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-fe8d619d-2a18-4938-859a-0b7bdb70f8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:56.226318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:56.227262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:56.228146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:56.228146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:56.228146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:56.228146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:56.231223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 320/628] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:56.232142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d619d-2a18-4938-859a-0b7bdb70f8dd None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.242638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 309/629] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:56.243756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d347f4a-7d9f-4073-9f24-5f5168b2bafe None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.275791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:56.350809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d619d-2a18-4938-859a-0b7bdb70f8dd None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:56.359599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d347f4a-7d9f-4073-9f24-5f5168b2bafe None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:56.390838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f47d0-3c3c-4410-aa28-721734ba829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:56.391925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f47d0-3c3c-4410-aa28-721734ba829c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.392459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f47d0-3c3c-4410-aa28-721734ba829c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.392595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f47d0-3c3c-4410-aa28-721734ba829c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.404602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f47d0-3c3c-4410-aa28-721734ba829c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:56.406003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16470f7f-641b-496a-96c4-73839073dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:56.406895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16470f7f-641b-496a-96c4-73839073dace None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.407401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16470f7f-641b-496a-96c4-73839073dace None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.407877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16470f7f-641b-496a-96c4-73839073dace None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.408843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16470f7f-641b-496a-96c4-73839073dace None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:56.409359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16470f7f-641b-496a-96c4-73839073dace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:56.410934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16470f7f-641b-496a-96c4-73839073dace None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-694f47d0-3c3c-4410-aa28-721734ba829c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:56.413444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:56.414376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:56.415227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:56.419538 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 321/630] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:56.420432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f47d0-3c3c-4410-aa28-721734ba829c None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.429228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 310/631] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:56.430431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16470f7f-641b-496a-96c4-73839073dace None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.484546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:56.525955 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:56.532471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f47d0-3c3c-4410-aa28-721734ba829c None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:56.548331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16470f7f-641b-496a-96c4-73839073dace None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:56.570661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552fe33-24ac-47d0-be49-59e73f9ef819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:56.571463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552fe33-24ac-47d0-be49-59e73f9ef819 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.572167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552fe33-24ac-47d0-be49-59e73f9ef819 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.572490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552fe33-24ac-47d0-be49-59e73f9ef819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.579345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552fe33-24ac-47d0-be49-59e73f9ef819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:56.580818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552fe33-24ac-47d0-be49-59e73f9ef819 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:56.587670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2210a67-ba1b-4913-a5c0-9f102636bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:56.588383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2210a67-ba1b-4913-a5c0-9f102636bb7d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.588672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2210a67-ba1b-4913-a5c0-9f102636bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.588949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2210a67-ba1b-4913-a5c0-9f102636bb7d None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.589714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2210a67-ba1b-4913-a5c0-9f102636bb7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:56.590024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2210a67-ba1b-4913-a5c0-9f102636bb7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:56.591489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2210a67-ba1b-4913-a5c0-9f102636bb7d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-f552fe33-24ac-47d0-be49-59e73f9ef819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:56.595479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:56.596520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:56.597435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:56.597435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:56.597435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:56.597435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:56.597435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:56.597435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:56.597435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:56.597435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:56.597435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 322/632] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:56.597957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552fe33-24ac-47d0-be49-59e73f9ef819 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.612062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 311/633] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:56.612062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac075b-cc19-4088-a3e7-9e8be6d867e6 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.612062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac075b-cc19-4088-a3e7-9e8be6d867e6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.612062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac075b-cc19-4088-a3e7-9e8be6d867e6 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.612062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 312/634] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:56.612062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac075b-cc19-4088-a3e7-9e8be6d867e6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.716133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552fe33-24ac-47d0-be49-59e73f9ef819 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:56.721093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac075b-cc19-4088-a3e7-9e8be6d867e6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:56.730839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:56.752944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb77aea-7de6-4ff1-ab31-ece1dadee7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:56.753751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb77aea-7de6-4ff1-ab31-ece1dadee7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.754038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb77aea-7de6-4ff1-ab31-ece1dadee7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.754315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb77aea-7de6-4ff1-ab31-ece1dadee7d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.761096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd07ec-41a9-4091-b1a6-e90aca772417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:56.761625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb77aea-7de6-4ff1-ab31-ece1dadee7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:56.762229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd07ec-41a9-4091-b1a6-e90aca772417 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.762663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd07ec-41a9-4091-b1a6-e90aca772417 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.763144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd07ec-41a9-4091-b1a6-e90aca772417 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.763259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb77aea-7de6-4ff1-ab31-ece1dadee7d6 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:56.764486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd07ec-41a9-4091-b1a6-e90aca772417 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:56.765131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd07ec-41a9-4091-b1a6-e90aca772417 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:56.767330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd07ec-41a9-4091-b1a6-e90aca772417 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-5eb77aea-7de6-4ff1-ab31-ece1dadee7d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:56.778775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:56.779899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 323/635] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:56.780908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb77aea-7de6-4ff1-ab31-ece1dadee7d6 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.792410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 313/636] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:56.792410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb18f1-ead0-4f9b-96d3-ea5e2bf7ba18 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.792410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb18f1-ead0-4f9b-96d3-ea5e2bf7ba18 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.792410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb18f1-ead0-4f9b-96d3-ea5e2bf7ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.798134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:56.807843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2feb18f1-ead0-4f9b-96d3-ea5e2bf7ba18 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:56.809076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2feb18f1-ead0-4f9b-96d3-ea5e2bf7ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:56.875868 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 314/637] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:56.876819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb18f1-ead0-4f9b-96d3-ea5e2bf7ba18 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.894639 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb77aea-7de6-4ff1-ab31-ece1dadee7d6 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:56.928406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbd53b-78c9-4e75-99b1-67c4c1ba8f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:56.929197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbd53b-78c9-4e75-99b1-67c4c1ba8f25 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.929479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbd53b-78c9-4e75-99b1-67c4c1ba8f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.929755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbd53b-78c9-4e75-99b1-67c4c1ba8f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.939799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbd53b-78c9-4e75-99b1-67c4c1ba8f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:56.941292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbd53b-78c9-4e75-99b1-67c4c1ba8f25 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-cbbbd53b-78c9-4e75-99b1-67c4c1ba8f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:56.959703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:56.960803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:56.961690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:56.961690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:56.961690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:56.961690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:56.961690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 324/638] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:56.962198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9fd7d-8542-4a51-8b31-8d4c14cbdd8d None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:56.962469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9fd7d-8542-4a51-8b31-8d4c14cbdd8d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:56.962746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9fd7d-8542-4a51-8b31-8d4c14cbdd8d None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:56.964002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 325/639] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:56.964697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9fd7d-8542-4a51-8b31-8d4c14cbdd8d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:56.975853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:56.979614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb18f1-ead0-4f9b-96d3-ea5e2bf7ba18 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.015406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e85a7-6ad8-46ad-ab5d-30508ed21d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.016062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e85a7-6ad8-46ad-ab5d-30508ed21d41 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.016379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e85a7-6ad8-46ad-ab5d-30508ed21d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.016924 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e85a7-6ad8-46ad-ab5d-30508ed21d41 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.017708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e85a7-6ad8-46ad-ab5d-30508ed21d41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:57.018017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e85a7-6ad8-46ad-ab5d-30508ed21d41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:57.019538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e85a7-6ad8-46ad-ab5d-30508ed21d41 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:57.031261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:57.031740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 315/640] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:57.032596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e85a7-6ad8-46ad-ab5d-30508ed21d41 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:57.068917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9fd7d-8542-4a51-8b31-8d4c14cbdd8d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.101980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704b078-3a7d-4673-b40b-a9dfb6541a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.102870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704b078-3a7d-4673-b40b-a9dfb6541a1c None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.103149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704b078-3a7d-4673-b40b-a9dfb6541a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.103419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704b078-3a7d-4673-b40b-a9dfb6541a1c None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/45f676694ec24de2a5c755e217baed87/roles/e521dfb490db4640aa9c1390bf4e209e` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.118267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704b078-3a7d-4673-b40b-a9dfb6541a1c None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=45f676694ec24de2a5c755e217baed87, role_id=e521dfb490db4640aa9c1390bf4e209e)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:57.119704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704b078-3a7d-4673-b40b-a9dfb6541a1c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:57.130877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e85a7-6ad8-46ad-ab5d-30508ed21d41 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.163841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eead8ca-eee4-4675-8934-242fca49883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.164658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eead8ca-eee4-4675-8934-242fca49883d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.164941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eead8ca-eee4-4675-8934-242fca49883d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.165215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eead8ca-eee4-4675-8934-242fca49883d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.175224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eead8ca-eee4-4675-8934-242fca49883d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-7eead8ca-eee4-4675-8934-242fca49883d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:57.183653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:57.184786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:57.185657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 316/641] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:57.186382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eead8ca-eee4-4675-8934-242fca49883d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:57.197788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 326/642] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:26:56 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/45f676694ec24de2a5c755e217baed87/roles/e521dfb490db4640aa9c1390bf4e209e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:57.197788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f26af-0522-4c78-a9fc-90f80eb99a2f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.197788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f26af-0522-4c78-a9fc-90f80eb99a2f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.197788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f26af-0522-4c78-a9fc-90f80eb99a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.211519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2b2f26af-0522-4c78-a9fc-90f80eb99a2f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:57.212877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2b2f26af-0522-4c78-a9fc-90f80eb99a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:57.218824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:57.292047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 327/643] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:57.293191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f26af-0522-4c78-a9fc-90f80eb99a2f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:57.327373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eead8ca-eee4-4675-8934-242fca49883d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.355293 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:57.366934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121db07-8cbb-49a7-9f50-1ef1cbd237de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.367920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121db07-8cbb-49a7-9f50-1ef1cbd237de None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.368279 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121db07-8cbb-49a7-9f50-1ef1cbd237de None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.368584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121db07-8cbb-49a7-9f50-1ef1cbd237de None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.369321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121db07-8cbb-49a7-9f50-1ef1cbd237de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:57.370071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121db07-8cbb-49a7-9f50-1ef1cbd237de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:57.371237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121db07-8cbb-49a7-9f50-1ef1cbd237de None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:57.386945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 317/644] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:57.387793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121db07-8cbb-49a7-9f50-1ef1cbd237de None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:57.415101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f26af-0522-4c78-a9fc-90f80eb99a2f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.451473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8b5ac-1850-40a8-a56f-23609fac0027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.452135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8b5ac-1850-40a8-a56f-23609fac0027 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.452453 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8b5ac-1850-40a8-a56f-23609fac0027 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.452731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8b5ac-1850-40a8-a56f-23609fac0027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.453567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8b5ac-1850-40a8-a56f-23609fac0027 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=951eca3289634609bcb684181e147ca3) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:57.453879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8b5ac-1850-40a8-a56f-23609fac0027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:57.455329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8b5ac-1850-40a8-a56f-23609fac0027 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:57.462161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 328/645] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/role_assignments?user.id=951eca3289634609bcb684181e147ca3&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:57.462878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8b5ac-1850-40a8-a56f-23609fac0027 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:57.496686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:57.520653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121db07-8cbb-49a7-9f50-1ef1cbd237de None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.570642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b79492-c362-44e0-be04-b51d2fab5619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.571344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b79492-c362-44e0-be04-b51d2fab5619 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.571773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b79492-c362-44e0-be04-b51d2fab5619 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.572676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b79492-c362-44e0-be04-b51d2fab5619 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.573468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b79492-c362-44e0-be04-b51d2fab5619 None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:57.573780 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b79492-c362-44e0-be04-b51d2fab5619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:57.575228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b79492-c362-44e0-be04-b51d2fab5619 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:57.588966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 318/646] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:57.588966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b79492-c362-44e0-be04-b51d2fab5619 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:57.618351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8b5ac-1850-40a8-a56f-23609fac0027 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.634806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:57.665731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6babd37-d977-49ed-9c08-3e07eb37dd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.667072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6babd37-d977-49ed-9c08-3e07eb37dd62 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.667429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6babd37-d977-49ed-9c08-3e07eb37dd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.667928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6babd37-d977-49ed-9c08-3e07eb37dd62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.680644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6babd37-d977-49ed-9c08-3e07eb37dd62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-d6babd37-d977-49ed-9c08-3e07eb37dd62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:26:57.688594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:57.689776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:26:57.690751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:57.696154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 329/647] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:57.699258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6babd37-d977-49ed-9c08-3e07eb37dd62 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:57.718955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b79492-c362-44e0-be04-b51d2fab5619 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.766133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db72f0-47b2-4201-aaef-70d3a94b2fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.767187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db72f0-47b2-4201-aaef-70d3a94b2fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.767473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db72f0-47b2-4201-aaef-70d3a94b2fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.767748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db72f0-47b2-4201-aaef-70d3a94b2fc6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.776885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db72f0-47b2-4201-aaef-70d3a94b2fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:57.778349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db72f0-47b2-4201-aaef-70d3a94b2fc6 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:57.781806 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-b9db72f0-47b2-4201-aaef-70d3a94b2fc6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:57.793901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:57.797478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 319/648] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:57.798448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db72f0-47b2-4201-aaef-70d3a94b2fc6 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:57.822596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6babd37-d977-49ed-9c08-3e07eb37dd62 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.862306 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec2fed-d2ac-46b0-9739-c3bb51dc70ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.863488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec2fed-d2ac-46b0-9739-c3bb51dc70ea None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.863993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec2fed-d2ac-46b0-9739-c3bb51dc70ea None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.865075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec2fed-d2ac-46b0-9739-c3bb51dc70ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.876526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec2fed-d2ac-46b0-9739-c3bb51dc70ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:57.878276 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec2fed-d2ac-46b0-9739-c3bb51dc70ea None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-78ec2fed-d2ac-46b0-9739-c3bb51dc70ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:57.897501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:57.898459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:57.899356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:57.899356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:57.899356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:57.899356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:57.901622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 330/649] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:57.902788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec2fed-d2ac-46b0-9739-c3bb51dc70ea None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:57.913100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db72f0-47b2-4201-aaef-70d3a94b2fc6 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:57.929540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:57.949699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364c633-c51e-4029-b45d-0f9c537a6be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:57.950361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364c633-c51e-4029-b45d-0f9c537a6be2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:57.950641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364c633-c51e-4029-b45d-0f9c537a6be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:57.950965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364c633-c51e-4029-b45d-0f9c537a6be2 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:57.952507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364c633-c51e-4029-b45d-0f9c537a6be2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:57.952507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364c633-c51e-4029-b45d-0f9c537a6be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:57.953398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364c633-c51e-4029-b45d-0f9c537a6be2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:57.963267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 320/650] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:57.964240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364c633-c51e-4029-b45d-0f9c537a6be2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.011879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec2fed-d2ac-46b0-9739-c3bb51dc70ea None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.029694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:58.048568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2574d-5a39-4592-89f2-fb941aa87e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.049337 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2574d-5a39-4592-89f2-fb941aa87e04 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.049715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2574d-5a39-4592-89f2-fb941aa87e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.050142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2574d-5a39-4592-89f2-fb941aa87e04 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:58.050977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2574d-5a39-4592-89f2-fb941aa87e04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:58.051350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2574d-5a39-4592-89f2-fb941aa87e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:58.053426 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2574d-5a39-4592-89f2-fb941aa87e04 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:58.072312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 331/651] 10.222.0.74 () {56 vars in 1137 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:58.073247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2574d-5a39-4592-89f2-fb941aa87e04 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.074608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364c633-c51e-4029-b45d-0f9c537a6be2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.111550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69e8a-1b94-4c80-bd6e-5d629e6160b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.112531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69e8a-1b94-4c80-bd6e-5d629e6160b9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.112958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69e8a-1b94-4c80-bd6e-5d629e6160b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.113399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69e8a-1b94-4c80-bd6e-5d629e6160b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:58.114271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec69e8a-1b94-4c80-bd6e-5d629e6160b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:58.114757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec69e8a-1b94-4c80-bd6e-5d629e6160b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:58.116456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec69e8a-1b94-4c80-bd6e-5d629e6160b9 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:58.130664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 321/652] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:58.131799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69e8a-1b94-4c80-bd6e-5d629e6160b9 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.164990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:58.184901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2574d-5a39-4592-89f2-fb941aa87e04 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.232187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316ea14-f842-4d04-8e71-d559eef59e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.233228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316ea14-f842-4d04-8e71-d559eef59e68 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.233755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316ea14-f842-4d04-8e71-d559eef59e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.234315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316ea14-f842-4d04-8e71-d559eef59e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:58.240034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69e8a-1b94-4c80-bd6e-5d629e6160b9 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.245493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316ea14-f842-4d04-8e71-d559eef59e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:58.247134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316ea14-f842-4d04-8e71-d559eef59e68 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:58.264183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-9316ea14-f842-4d04-8e71-d559eef59e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:58.267535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:58.268634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:58.269806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:58.269806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:58.269806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:58.269806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:58.272200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 332/653] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:58.275323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316ea14-f842-4d04-8e71-d559eef59e68 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.277616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60deb184-1bda-43b7-86d8-bbd58e7a4750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.277772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deb184-1bda-43b7-86d8-bbd58e7a4750 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.278038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deb184-1bda-43b7-86d8-bbd58e7a4750 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.278323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deb184-1bda-43b7-86d8-bbd58e7a4750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:58.367651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60deb184-1bda-43b7-86d8-bbd58e7a4750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:58.369241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60deb184-1bda-43b7-86d8-bbd58e7a4750 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:58.384889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316ea14-f842-4d04-8e71-d559eef59e68 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.419496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:58.425852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa0788-5e29-4565-bc44-29f227d7dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.427452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa0788-5e29-4565-bc44-29f227d7dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.429882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa0788-5e29-4565-bc44-29f227d7dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.429882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa0788-5e29-4565-bc44-29f227d7dbb0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:58.436991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa0788-5e29-4565-bc44-29f227d7dbb0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:58.438931 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa0788-5e29-4565-bc44-29f227d7dbb0 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-24aa0788-5e29-4565-bc44-29f227d7dbb0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:58.456919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:58.457935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:26:58.458958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:58.466208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 333/654] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:26:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:58.467292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa0788-5e29-4565-bc44-29f227d7dbb0 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.482969 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 322/655] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:58.483949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60deb184-1bda-43b7-86d8-bbd58e7a4750 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.511272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:58.576206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa0788-5e29-4565-bc44-29f227d7dbb0 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.594910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60deb184-1bda-43b7-86d8-bbd58e7a4750 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.614062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8a68e-58d5-4ac6-848f-6ed4f2d48b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.615116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8a68e-58d5-4ac6-848f-6ed4f2d48b87 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.615645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8a68e-58d5-4ac6-848f-6ed4f2d48b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.616125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8a68e-58d5-4ac6-848f-6ed4f2d48b87 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:58.617075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8a68e-58d5-4ac6-848f-6ed4f2d48b87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:58.617741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8a68e-58d5-4ac6-848f-6ed4f2d48b87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:58.619342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8a68e-58d5-4ac6-848f-6ed4f2d48b87 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:58.632004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 334/656] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:58.633058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8a68e-58d5-4ac6-848f-6ed4f2d48b87 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.637216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1089ce-3ce9-41e6-b41a-03824fe5d928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.637723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1089ce-3ce9-41e6-b41a-03824fe5d928 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.638017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1089ce-3ce9-41e6-b41a-03824fe5d928 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.638300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1089ce-3ce9-41e6-b41a-03824fe5d928 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:58.639141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1089ce-3ce9-41e6-b41a-03824fe5d928 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:58.639453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1089ce-3ce9-41e6-b41a-03824fe5d928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:58.640993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1089ce-3ce9-41e6-b41a-03824fe5d928 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:58.666940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 323/657] 10.222.0.74 () {56 vars in 1137 bytes} [Mon May 23 16:26:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:58.666940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1089ce-3ce9-41e6-b41a-03824fe5d928 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.696131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:58.748138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8a68e-58d5-4ac6-848f-6ed4f2d48b87 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.754512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:58.778366 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1089ce-3ce9-41e6-b41a-03824fe5d928 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.788531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad4055-e0d4-45e4-9513-9f4db6437a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.789675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad4055-e0d4-45e4-9513-9f4db6437a35 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.790166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad4055-e0d4-45e4-9513-9f4db6437a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.790663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad4055-e0d4-45e4-9513-9f4db6437a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:58.804340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad4055-e0d4-45e4-9513-9f4db6437a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:58.806637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad4055-e0d4-45e4-9513-9f4db6437a35 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:58.819282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f673c-0d55-43d9-9470-3e82425a13ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.820083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f673c-0d55-43d9-9470-3e82425a13ad None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.820398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f673c-0d55-43d9-9470-3e82425a13ad None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.820675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f673c-0d55-43d9-9470-3e82425a13ad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:58.828151 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f673c-0d55-43d9-9470-3e82425a13ad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:58.829645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f673c-0d55-43d9-9470-3e82425a13ad None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-64ad4055-e0d4-45e4-9513-9f4db6437a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:58.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:58.836279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:58.837229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:58.837229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:58.837229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:58.837229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:58.844503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 335/658] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:58.844503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad4055-e0d4-45e4-9513-9f4db6437a35 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-708f673c-0d55-43d9-9470-3e82425a13ad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:26:58.853515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:58.854641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 16:26:58.855695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:58.857892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 324/659] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:26:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:58.858883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f673c-0d55-43d9-9470-3e82425a13ad None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:58.945879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad4055-e0d4-45e4-9513-9f4db6437a35 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.948708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:58.972154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f673c-0d55-43d9-9470-3e82425a13ad None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:58.981799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7ee95-6466-48a6-8773-7ad76015c046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:58.982458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7ee95-6466-48a6-8773-7ad76015c046 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:58.982742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7ee95-6466-48a6-8773-7ad76015c046 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:58.983021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7ee95-6466-48a6-8773-7ad76015c046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.010169 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de510640-d922-49ef-8637-eda623a34e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:59.011154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de510640-d922-49ef-8637-eda623a34e06 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.011631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de510640-d922-49ef-8637-eda623a34e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.012048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de510640-d922-49ef-8637-eda623a34e06 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.013004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de510640-d922-49ef-8637-eda623a34e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:59.013471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de510640-d922-49ef-8637-eda623a34e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:59.015022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de510640-d922-49ef-8637-eda623a34e06 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:59.025553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:59.032434 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 325/660] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:59.032434 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de510640-d922-49ef-8637-eda623a34e06 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:59.062919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7ee95-6466-48a6-8773-7ad76015c046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:59.064450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7ee95-6466-48a6-8773-7ad76015c046 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:59.134802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de510640-d922-49ef-8637-eda623a34e06 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:59.171227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 336/661] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:59.171997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469131-6fdd-4a85-9f69-e3bfb4f10b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:59.172148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7ee95-6466-48a6-8773-7ad76015c046 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:59.173083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469131-6fdd-4a85-9f69-e3bfb4f10b15 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.173578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469131-6fdd-4a85-9f69-e3bfb4f10b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.174091 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469131-6fdd-4a85-9f69-e3bfb4f10b15 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.175232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9469131-6fdd-4a85-9f69-e3bfb4f10b15 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:59.175770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9469131-6fdd-4a85-9f69-e3bfb4f10b15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:59.177993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9469131-6fdd-4a85-9f69-e3bfb4f10b15 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:59.188661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:59.288775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7ee95-6466-48a6-8773-7ad76015c046 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:59.330185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 326/662] 10.222.0.74 () {56 vars in 1139 bytes} [Mon May 23 16:26:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:59.331839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469131-6fdd-4a85-9f69-e3bfb4f10b15 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:59.335238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8694c-1a13-4fdd-bb8a-1d45e0601cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:59.335238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8694c-1a13-4fdd-bb8a-1d45e0601cae None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.335238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8694c-1a13-4fdd-bb8a-1d45e0601cae None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.335238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8694c-1a13-4fdd-bb8a-1d45e0601cae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.343630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8694c-1a13-4fdd-bb8a-1d45e0601cae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:59.345431 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8694c-1a13-4fdd-bb8a-1d45e0601cae None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-71b8694c-1a13-4fdd-bb8a-1d45e0601cae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:26:59.360921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:59.361860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:59.363159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:26:59.363159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:26:59.363159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:26:59.363159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:26:59.363159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:26:59.363159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:26:59.363159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:26:59.363159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:26:59.363159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 337/663] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:59.363672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8694c-1a13-4fdd-bb8a-1d45e0601cae None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:59.402291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:59.447090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469131-6fdd-4a85-9f69-e3bfb4f10b15 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:59.460684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:59.481895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8694c-1a13-4fdd-bb8a-1d45e0601cae None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:59.484922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14740c-5d41-47f2-8c53-37e28e522f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:59.485962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14740c-5d41-47f2-8c53-37e28e522f0d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.486439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14740c-5d41-47f2-8c53-37e28e522f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.486928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14740c-5d41-47f2-8c53-37e28e522f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.498982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14740c-5d41-47f2-8c53-37e28e522f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:59.500733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14740c-5d41-47f2-8c53-37e28e522f0d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:59.516195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1ba54-398d-4a64-abab-fed204335124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:59.517131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ba54-398d-4a64-abab-fed204335124 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.517413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ba54-398d-4a64-abab-fed204335124 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.517692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ba54-398d-4a64-abab-fed204335124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-ca14740c-5d41-47f2-8c53-37e28e522f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:26:59.520785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:26:59.521829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:26:59.522928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:26:59.522928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:26:59.522928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:26:59.522928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:26:59.524588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 327/664] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:26:59.525580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14740c-5d41-47f2-8c53-37e28e522f0d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:59.590172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1ba54-398d-4a64-abab-fed204335124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:59.591645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1ba54-398d-4a64-abab-fed204335124 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:59.633714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14740c-5d41-47f2-8c53-37e28e522f0d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:59.644695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:59.659821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:59.669638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ec531-95c1-417e-93e5-97dde1d7a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:59.670299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ec531-95c1-417e-93e5-97dde1d7a051 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.670584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ec531-95c1-417e-93e5-97dde1d7a051 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.670862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ec531-95c1-417e-93e5-97dde1d7a051 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.671649 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ec531-95c1-417e-93e5-97dde1d7a051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:59.672020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ec531-95c1-417e-93e5-97dde1d7a051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:59.673533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ec531-95c1-417e-93e5-97dde1d7a051 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:59.688274 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 328/665] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:59.689890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11984cab-ab46-4f09-9a1e-766cfdee96ca None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.695115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11984cab-ab46-4f09-9a1e-766cfdee96ca None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.695115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11984cab-ab46-4f09-9a1e-766cfdee96ca None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.695115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 329/666] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:26:59.695115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11984cab-ab46-4f09-9a1e-766cfdee96ca None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:59.706891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 338/667] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:26:59.708773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1ba54-398d-4a64-abab-fed204335124 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:59.806009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11984cab-ab46-4f09-9a1e-766cfdee96ca None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:59.836469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1ba54-398d-4a64-abab-fed204335124 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:59.842430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ed3a7-9122-4dd1-bc21-a4ee66af3f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:59.843095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed3a7-9122-4dd1-bc21-a4ee66af3f78 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.843380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed3a7-9122-4dd1-bc21-a4ee66af3f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.843654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed3a7-9122-4dd1-bc21-a4ee66af3f78 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.844821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ed3a7-9122-4dd1-bc21-a4ee66af3f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:59.845133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ed3a7-9122-4dd1-bc21-a4ee66af3f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:59.846847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ed3a7-9122-4dd1-bc21-a4ee66af3f78 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:59.863470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 330/668] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:59.863470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd260d-e604-41c3-8dc2-4cee85a2c15a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.863470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd260d-e604-41c3-8dc2-4cee85a2c15a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.863470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd260d-e604-41c3-8dc2-4cee85a2c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.877397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-28fd260d-e604-41c3-8dc2-4cee85a2c15a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:59.878053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a72fe-78d7-44ce-bbde-5e7c789ecb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:59.878570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-28fd260d-e604-41c3-8dc2-4cee85a2c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:59.878754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a72fe-78d7-44ce-bbde-5e7c789ecb28 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:59.879000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a72fe-78d7-44ce-bbde-5e7c789ecb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:59.879275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a72fe-78d7-44ce-bbde-5e7c789ecb28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:59.880676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a72fe-78d7-44ce-bbde-5e7c789ecb28 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=e9533e8371e64161a4c54eeab867a17e) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:59.880989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a72fe-78d7-44ce-bbde-5e7c789ecb28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:59.883399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a72fe-78d7-44ce-bbde-5e7c789ecb28 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:59.889654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 339/669] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:26:59 2022] GET /identity/v3/role_assignments?user.id=e9533e8371e64161a4c54eeab867a17e&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:59.890454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a72fe-78d7-44ce-bbde-5e7c789ecb28 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:59.920457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:59.934403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:59.966762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 331/670] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:26:59.968426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd260d-e604-41c3-8dc2-4cee85a2c15a None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.019686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a72fe-78d7-44ce-bbde-5e7c789ecb28 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.064055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bcc50-de97-4a42-902b-e26cc70e8caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.065083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bcc50-de97-4a42-902b-e26cc70e8caf None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.065365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bcc50-de97-4a42-902b-e26cc70e8caf None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.065643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bcc50-de97-4a42-902b-e26cc70e8caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.078918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bcc50-de97-4a42-902b-e26cc70e8caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:00.080552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bcc50-de97-4a42-902b-e26cc70e8caf None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:00.085510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd260d-e604-41c3-8dc2-4cee85a2c15a None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-b41bcc50-de97-4a42-902b-e26cc70e8caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:00.101944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:00.102888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:00.103791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:00.103791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:00.103791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:00.103791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:00.103791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 340/671] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:00.104580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f9891-6858-420c-a829-da6250141aea None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.104861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f9891-6858-420c-a829-da6250141aea None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.105118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f9891-6858-420c-a829-da6250141aea None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.106509 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 341/672] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:00.107112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f9891-6858-420c-a829-da6250141aea None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.134554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3779ce-9796-45a2-a215-487a5eb9c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.135706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3779ce-9796-45a2-a215-487a5eb9c4dc None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.136584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3779ce-9796-45a2-a215-487a5eb9c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.137007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3779ce-9796-45a2-a215-487a5eb9c4dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.145229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3779ce-9796-45a2-a215-487a5eb9c4dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:00.146901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3779ce-9796-45a2-a215-487a5eb9c4dc None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-ab3779ce-9796-45a2-a215-487a5eb9c4dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:00.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:00.163323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:00.164318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:00.164318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:00.164318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:00.164318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:00.164318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:00.164318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:00.164318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:00.164318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:00.164318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 332/673] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:00.164832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3779ce-9796-45a2-a215-487a5eb9c4dc None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.187287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:00.209154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:00.235298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f9891-6858-420c-a829-da6250141aea None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.272655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3779ce-9796-45a2-a215-487a5eb9c4dc None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.274672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878abdf-2322-48db-b77e-83870102f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.276279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878abdf-2322-48db-b77e-83870102f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.276592 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878abdf-2322-48db-b77e-83870102f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.276870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878abdf-2322-48db-b77e-83870102f7e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.289344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878abdf-2322-48db-b77e-83870102f7e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-f878abdf-2322-48db-b77e-83870102f7e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:00.297031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:00.298230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:00.299123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 342/674] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:00.299840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b334-e147-43c4-b22c-6ec977fd96f0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.299840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b334-e147-43c4-b22c-6ec977fd96f0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.299967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b334-e147-43c4-b22c-6ec977fd96f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.314534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163f37d-486e-4d17-9192-a9303ef23f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.315159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163f37d-486e-4d17-9192-a9303ef23f51 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.315445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163f37d-486e-4d17-9192-a9303ef23f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.315721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163f37d-486e-4d17-9192-a9303ef23f51 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.316482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163f37d-486e-4d17-9192-a9303ef23f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:00.316793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163f37d-486e-4d17-9192-a9303ef23f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:00.317134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-f255b334-e147-43c4-b22c-6ec977fd96f0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:00.318752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163f37d-486e-4d17-9192-a9303ef23f51 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:00.319166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f255b334-e147-43c4-b22c-6ec977fd96f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:00.335781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 333/675] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:00.335781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163f37d-486e-4d17-9192-a9303ef23f51 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.396803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 343/676] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:27:00.397603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255b334-e147-43c4-b22c-6ec977fd96f0 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.433743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:00.454664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163f37d-486e-4d17-9192-a9303ef23f51 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.488942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:00.493985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663e5bf-9958-4e03-9c01-d05a46b0fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.494824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e5bf-9958-4e03-9c01-d05a46b0fc73 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.495286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e5bf-9958-4e03-9c01-d05a46b0fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.495703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e5bf-9958-4e03-9c01-d05a46b0fc73 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.496680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e5bf-9958-4e03-9c01-d05a46b0fc73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:00.497131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e5bf-9958-4e03-9c01-d05a46b0fc73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:00.498892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e5bf-9958-4e03-9c01-d05a46b0fc73 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:00.516988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 334/677] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:00.516988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663e5bf-9958-4e03-9c01-d05a46b0fc73 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.527311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255b334-e147-43c4-b22c-6ec977fd96f0 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.562208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c81d52-269d-4f45-84ad-f4096d2a8342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.562882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c81d52-269d-4f45-84ad-f4096d2a8342 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.563176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c81d52-269d-4f45-84ad-f4096d2a8342 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.563454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c81d52-269d-4f45-84ad-f4096d2a8342 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.564200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c81d52-269d-4f45-84ad-f4096d2a8342 None admin] RBAC: Adding query filter params (name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:00.564596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c81d52-269d-4f45-84ad-f4096d2a8342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:00.565909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c81d52-269d-4f45-84ad-f4096d2a8342 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:00.574276 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 344/678] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:00.574276 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c81d52-269d-4f45-84ad-f4096d2a8342 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.626085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663e5bf-9958-4e03-9c01-d05a46b0fc73 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.664826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569028c-1a97-4e19-89ae-19e4dd24074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.665619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569028c-1a97-4e19-89ae-19e4dd24074f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.665900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569028c-1a97-4e19-89ae-19e4dd24074f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.666171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569028c-1a97-4e19-89ae-19e4dd24074f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.672989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569028c-1a97-4e19-89ae-19e4dd24074f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:00.674418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569028c-1a97-4e19-89ae-19e4dd24074f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:00.677715 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:00.679778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c81d52-269d-4f45-84ad-f4096d2a8342 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-f569028c-1a97-4e19-89ae-19e4dd24074f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:00.691231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:00.693877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:00.695243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:00.695243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:00.695243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:00.695243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:00.695243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:00.695243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:00.695243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:00.695243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:00.697817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 335/679] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:00.698705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569028c-1a97-4e19-89ae-19e4dd24074f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.714027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:00.720020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cbe7e-bdf8-4d83-9ece-5409d137daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.720876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cbe7e-bdf8-4d83-9ece-5409d137daa3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.721259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cbe7e-bdf8-4d83-9ece-5409d137daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.721536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cbe7e-bdf8-4d83-9ece-5409d137daa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.733493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cbe7e-bdf8-4d83-9ece-5409d137daa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-f98cbe7e-bdf8-4d83-9ece-5409d137daa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:00.741566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:00.748202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 345/680] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:00.749105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cbe7e-bdf8-4d83-9ece-5409d137daa3 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.812752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569028c-1a97-4e19-89ae-19e4dd24074f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.848529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef523-a35e-4ea9-9ed5-1fae28b6a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.849268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef523-a35e-4ea9-9ed5-1fae28b6a544 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.849551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef523-a35e-4ea9-9ed5-1fae28b6a544 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.849831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef523-a35e-4ea9-9ed5-1fae28b6a544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.850651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ef523-a35e-4ea9-9ed5-1fae28b6a544 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=6d377792af1c4ad19519e2e98bac72e5) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:00.850962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ef523-a35e-4ea9-9ed5-1fae28b6a544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:00.852420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ef523-a35e-4ea9-9ed5-1fae28b6a544 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:00.854827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cbe7e-bdf8-4d83-9ece-5409d137daa3 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:00.858491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 336/681] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/role_assignments?user.id=6d377792af1c4ad19519e2e98bac72e5&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:00.861256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef523-a35e-4ea9-9ed5-1fae28b6a544 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.895249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c461d-dd1d-4841-be1c-0bca517cecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:00.896645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c461d-dd1d-4841-be1c-0bca517cecd4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:00.897582 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c461d-dd1d-4841-be1c-0bca517cecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:00.897582 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c461d-dd1d-4841-be1c-0bca517cecd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:00.909213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c461d-dd1d-4841-be1c-0bca517cecd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:00.910910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c461d-dd1d-4841-be1c-0bca517cecd4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-6d7c461d-dd1d-4841-be1c-0bca517cecd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:00.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:00.933461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:00.934336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:00.934336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:00.934336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:00.934336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:00.938553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 346/682] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:00.939524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c461d-dd1d-4841-be1c-0bca517cecd4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:00.956440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:00.995749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:01.014124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef523-a35e-4ea9-9ed5-1fae28b6a544 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.064712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c461d-dd1d-4841-be1c-0bca517cecd4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.065272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fb7f-087c-419d-bf4b-3065b01e608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.065943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fb7f-087c-419d-bf4b-3065b01e608a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.066224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fb7f-087c-419d-bf4b-3065b01e608a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.066493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fb7f-087c-419d-bf4b-3065b01e608a None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:01.067934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fb7f-087c-419d-bf4b-3065b01e608a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:01.068325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fb7f-087c-419d-bf4b-3065b01e608a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:01.070052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fb7f-087c-419d-bf4b-3065b01e608a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:01.083703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 337/683] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:01.084627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fb7f-087c-419d-bf4b-3065b01e608a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:01.117217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a71182-c778-43e8-833a-0308c3354b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.117827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71182-c778-43e8-833a-0308c3354b2d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.118108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71182-c778-43e8-833a-0308c3354b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.118379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71182-c778-43e8-833a-0308c3354b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:01.119140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a71182-c778-43e8-833a-0308c3354b2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:01.119444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a71182-c778-43e8-833a-0308c3354b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:01.120938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a71182-c778-43e8-833a-0308c3354b2d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:01.131832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 347/684] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:01.132861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a71182-c778-43e8-833a-0308c3354b2d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:01.214181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fb7f-087c-419d-bf4b-3065b01e608a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.242260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:01.253791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dabe8-fe44-4704-8a82-047d7c326dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.254773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dabe8-fe44-4704-8a82-047d7c326dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.255237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dabe8-fe44-4704-8a82-047d7c326dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.255673 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dabe8-fe44-4704-8a82-047d7c326dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:01.259734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277dabe8-fe44-4704-8a82-047d7c326dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:01.259734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277dabe8-fe44-4704-8a82-047d7c326dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:01.259734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277dabe8-fe44-4704-8a82-047d7c326dc5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:01.264164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a71182-c778-43e8-833a-0308c3354b2d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.272045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 338/685] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:01.273335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dabe8-fe44-4704-8a82-047d7c326dc5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:01.273562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:01.312049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99c49e-cf2a-418a-b154-46126d744ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.312758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c49e-cf2a-418a-b154-46126d744ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.313042 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c49e-cf2a-418a-b154-46126d744ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.313321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c49e-cf2a-418a-b154-46126d744ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:01.315294 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c49e-cf2a-418a-b154-46126d744ee7 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=a833149a66af4452aeedd5d43f2fb2eb) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:01.315636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c49e-cf2a-418a-b154-46126d744ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:01.317107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c49e-cf2a-418a-b154-46126d744ee7 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:01.325566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 348/686] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:01 2022] GET /identity/v3/role_assignments?user.id=a833149a66af4452aeedd5d43f2fb2eb&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:01.326472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99c49e-cf2a-418a-b154-46126d744ee7 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:01.399188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dabe8-fe44-4704-8a82-047d7c326dc5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.473753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10606cb0-39a6-414a-b432-e65ae57f2040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.474717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10606cb0-39a6-414a-b432-e65ae57f2040 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.475001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10606cb0-39a6-414a-b432-e65ae57f2040 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.475281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10606cb0-39a6-414a-b432-e65ae57f2040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:01.491567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99c49e-cf2a-418a-b154-46126d744ee7 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.498893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10606cb0-39a6-414a-b432-e65ae57f2040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:01.500384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10606cb0-39a6-414a-b432-e65ae57f2040 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-10606cb0-39a6-414a-b432-e65ae57f2040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:01.519493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:01.521023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:01.521916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:01.521916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:01.521916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:01.521916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:01.526477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 339/687] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:01.527772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10606cb0-39a6-414a-b432-e65ae57f2040 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:01.552045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6800877-596e-4dc7-931a-8b5c013d6391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.553029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6800877-596e-4dc7-931a-8b5c013d6391 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.553423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6800877-596e-4dc7-931a-8b5c013d6391 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.553961 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6800877-596e-4dc7-931a-8b5c013d6391 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:01.569917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6800877-596e-4dc7-931a-8b5c013d6391 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:01.571425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6800877-596e-4dc7-931a-8b5c013d6391 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-a6800877-596e-4dc7-931a-8b5c013d6391 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:01.594175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:01.595224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:27:01.596165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:01.600423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 349/688] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:01.602623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6800877-596e-4dc7-931a-8b5c013d6391 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:01.605752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:01.634667 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:01.687985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10606cb0-39a6-414a-b432-e65ae57f2040 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.718847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6800877-596e-4dc7-931a-8b5c013d6391 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.736857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af7e89-29a5-4f45-a3b9-e01bf84663a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.737801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af7e89-29a5-4f45-a3b9-e01bf84663a8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.738094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af7e89-29a5-4f45-a3b9-e01bf84663a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.738372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af7e89-29a5-4f45-a3b9-e01bf84663a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:01.739452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af7e89-29a5-4f45-a3b9-e01bf84663a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:01.739770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af7e89-29a5-4f45-a3b9-e01bf84663a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:01.741604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af7e89-29a5-4f45-a3b9-e01bf84663a8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:01.758869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 340/689] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:01.762201 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647b1d6-771a-467d-a958-be1c6c5fc927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.763093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b1d6-771a-467d-a958-be1c6c5fc927 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.763563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b1d6-771a-467d-a958-be1c6c5fc927 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.763973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b1d6-771a-467d-a958-be1c6c5fc927 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:01.764234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af7e89-29a5-4f45-a3b9-e01bf84663a8 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:01.765279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647b1d6-771a-467d-a958-be1c6c5fc927 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:01.765733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647b1d6-771a-467d-a958-be1c6c5fc927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:01.767866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647b1d6-771a-467d-a958-be1c6c5fc927 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:01.789424 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 350/690] 10.222.0.74 () {56 vars in 1135 bytes} [Mon May 23 16:27:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:01.795418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647b1d6-771a-467d-a958-be1c6c5fc927 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:01.899485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:01.902894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:01.914945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647b1d6-771a-467d-a958-be1c6c5fc927 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.918364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af7e89-29a5-4f45-a3b9-e01bf84663a8 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:01.955494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463038-1370-4c89-a8ce-22fdc0f1b20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.956487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463038-1370-4c89-a8ce-22fdc0f1b20e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.956948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463038-1370-4c89-a8ce-22fdc0f1b20e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.957399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463038-1370-4c89-a8ce-22fdc0f1b20e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:01.995643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ed15f-2d5f-4a18-a87b-08fcbefb240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:01.996470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ed15f-2d5f-4a18-a87b-08fcbefb240d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:01.996752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ed15f-2d5f-4a18-a87b-08fcbefb240d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:01.997025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ed15f-2d5f-4a18-a87b-08fcbefb240d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.018172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ed15f-2d5f-4a18-a87b-08fcbefb240d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:02.019697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ed15f-2d5f-4a18-a87b-08fcbefb240d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:02.037274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8463038-1370-4c89-a8ce-22fdc0f1b20e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:02.039021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8463038-1370-4c89-a8ce-22fdc0f1b20e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-c82ed15f-2d5f-4a18-a87b-08fcbefb240d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:02.044676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:02.045695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:02.046652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 341/691] 10.222.0.74 () {56 vars in 1093 bytes} [Mon May 23 16:27:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:02.052971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ed15f-2d5f-4a18-a87b-08fcbefb240d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:02.144780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:02.160420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 351/692] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:27:02.165683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463038-1370-4c89-a8ce-22fdc0f1b20e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:02.263925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ed15f-2d5f-4a18-a87b-08fcbefb240d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:02.309121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39339e02-02e5-462d-bb72-1b3e130d3aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:02.309804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39339e02-02e5-462d-bb72-1b3e130d3aba None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:02.310082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39339e02-02e5-462d-bb72-1b3e130d3aba None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:02.310348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39339e02-02e5-462d-bb72-1b3e130d3aba None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.311193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39339e02-02e5-462d-bb72-1b3e130d3aba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:02.311497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39339e02-02e5-462d-bb72-1b3e130d3aba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:02.313468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39339e02-02e5-462d-bb72-1b3e130d3aba None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:02.339093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 342/693] 10.222.0.74 () {56 vars in 1133 bytes} [Mon May 23 16:27:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:02.340194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463038-1370-4c89-a8ce-22fdc0f1b20e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:02.340449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cc4ca-f0bf-4c70-8916-d71c2ec06220 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:02.340737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cc4ca-f0bf-4c70-8916-d71c2ec06220 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:02.341010 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cc4ca-f0bf-4c70-8916-d71c2ec06220 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.346296 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 343/694] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:02.347572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748208-ad8e-4c8e-bc6b-0dec6606676b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:02.352542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748208-ad8e-4c8e-bc6b-0dec6606676b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:02.353550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748208-ad8e-4c8e-bc6b-0dec6606676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.377180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-31748208-ad8e-4c8e-bc6b-0dec6606676b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:02.379273 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-31748208-ad8e-4c8e-bc6b-0dec6606676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:02.386461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b989c-e3ca-4109-af2a-0a90bf9ca31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:02.387274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b989c-e3ca-4109-af2a-0a90bf9ca31f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:02.387556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b989c-e3ca-4109-af2a-0a90bf9ca31f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:02.387837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b989c-e3ca-4109-af2a-0a90bf9ca31f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.400210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b989c-e3ca-4109-af2a-0a90bf9ca31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:02.401732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b989c-e3ca-4109-af2a-0a90bf9ca31f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:02.402667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-5c3b989c-e3ca-4109-af2a-0a90bf9ca31f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:02.423452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:02.426794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:02.427721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:02.427721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:02.427721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:02.427721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:02.427721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 352/695] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:02.427721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b989c-e3ca-4109-af2a-0a90bf9ca31f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:02.455846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 344/696] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:27:02.457301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748208-ad8e-4c8e-bc6b-0dec6606676b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:02.490253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:02.558289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748208-ad8e-4c8e-bc6b-0dec6606676b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:02.569004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b989c-e3ca-4109-af2a-0a90bf9ca31f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:02.593480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ce666-a718-425f-a9b8-596ffa83d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:02.594237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ce666-a718-425f-a9b8-596ffa83d8bb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:02.594590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ce666-a718-425f-a9b8-596ffa83d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:02.594934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ce666-a718-425f-a9b8-596ffa83d8bb None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.595724 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ce666-a718-425f-a9b8-596ffa83d8bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:02.596097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ce666-a718-425f-a9b8-596ffa83d8bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:02.597578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ce666-a718-425f-a9b8-596ffa83d8bb None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:02.607368 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d0852-17ae-4c98-a4da-b98b82081810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:02.608019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d0852-17ae-4c98-a4da-b98b82081810 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:02.608328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d0852-17ae-4c98-a4da-b98b82081810 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:02.608612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d0852-17ae-4c98-a4da-b98b82081810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.615368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 345/697] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:02.616282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ce666-a718-425f-a9b8-596ffa83d8bb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:02.621366 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:02.687805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d0852-17ae-4c98-a4da-b98b82081810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:02.689458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d0852-17ae-4c98-a4da-b98b82081810 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:02.720959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ce666-a718-425f-a9b8-596ffa83d8bb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:02.737664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:02.756592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57245bfb-8ee8-41c7-b840-510c16af179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:02.757320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57245bfb-8ee8-41c7-b840-510c16af179d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:02.757726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57245bfb-8ee8-41c7-b840-510c16af179d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:02.757998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57245bfb-8ee8-41c7-b840-510c16af179d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.769060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57245bfb-8ee8-41c7-b840-510c16af179d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:02.771057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57245bfb-8ee8-41c7-b840-510c16af179d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-57245bfb-8ee8-41c7-b840-510c16af179d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:02.788700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:02.790933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:02.793411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:02.793411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:02.793411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:02.793411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:02.793411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 346/698] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:02.793411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57245bfb-8ee8-41c7-b840-510c16af179d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:02.812102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 353/699] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 16:27:02.813173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d0852-17ae-4c98-a4da-b98b82081810 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:02.849275 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:02.896349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57245bfb-8ee8-41c7-b840-510c16af179d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:02.931041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190b715-6f92-44fa-872a-69dc904d0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:02.931432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d0852-17ae-4c98-a4da-b98b82081810 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:02.931833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190b715-6f92-44fa-872a-69dc904d0ddf None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:02.932110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190b715-6f92-44fa-872a-69dc904d0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:02.932409 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190b715-6f92-44fa-872a-69dc904d0ddf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.939356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190b715-6f92-44fa-872a-69dc904d0ddf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:02.940835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190b715-6f92-44fa-872a-69dc904d0ddf None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-e190b715-6f92-44fa-872a-69dc904d0ddf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:02.956600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:02.958799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:02.961117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:02.961117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:02.961117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:02.961117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:02.961117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:02.961117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:02.961117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:02.961117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:02.964411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 347/700] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:02.964411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190b715-6f92-44fa-872a-69dc904d0ddf None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:02.971040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d631-534e-4570-87a1-5d4070e2fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:02.971722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d631-534e-4570-87a1-5d4070e2fc8e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:02.972120 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d631-534e-4570-87a1-5d4070e2fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:02.972430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d631-534e-4570-87a1-5d4070e2fc8e None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:02.973165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d631-534e-4570-87a1-5d4070e2fc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:02.973564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d631-534e-4570-87a1-5d4070e2fc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:02.975818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d631-534e-4570-87a1-5d4070e2fc8e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:02.988346 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:02.998435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 354/701] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:02.999403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d631-534e-4570-87a1-5d4070e2fc8e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:03.072353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190b715-6f92-44fa-872a-69dc904d0ddf None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:03.090059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:03.108156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1a0a1-9256-4cf9-8660-2dc4d571afe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:03.109414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1a0a1-9256-4cf9-8660-2dc4d571afe2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.109908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1a0a1-9256-4cf9-8660-2dc4d571afe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.110376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1a0a1-9256-4cf9-8660-2dc4d571afe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.118340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d631-534e-4570-87a1-5d4070e2fc8e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:03.122095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1a0a1-9256-4cf9-8660-2dc4d571afe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:03.123867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1a0a1-9256-4cf9-8660-2dc4d571afe2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-10f1a0a1-9256-4cf9-8660-2dc4d571afe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:03.143081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:03.143998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:03.145320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:03.145320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:03.145320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:03.145320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:03.147287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 348/702] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:03.148373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1a0a1-9256-4cf9-8660-2dc4d571afe2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:03.156395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaac32-75a6-44d2-9120-edbad7144d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:03.157065 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaac32-75a6-44d2-9120-edbad7144d3e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.157346 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaac32-75a6-44d2-9120-edbad7144d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.157620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaac32-75a6-44d2-9120-edbad7144d3e None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.158864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaac32-75a6-44d2-9120-edbad7144d3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:03.158974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaac32-75a6-44d2-9120-edbad7144d3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:03.160378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaac32-75a6-44d2-9120-edbad7144d3e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:03.179540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 355/703] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:03.179540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaac32-75a6-44d2-9120-edbad7144d3e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:03.240653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:03.270678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1a0a1-9256-4cf9-8660-2dc4d571afe2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:03.285615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaac32-75a6-44d2-9120-edbad7144d3e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:03.306457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5811990-0932-4ac0-a959-19d5cc630d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:03.307262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5811990-0932-4ac0-a959-19d5cc630d94 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.307645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5811990-0932-4ac0-a959-19d5cc630d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.308018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5811990-0932-4ac0-a959-19d5cc630d94 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.308865 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5811990-0932-4ac0-a959-19d5cc630d94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:03.310385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5811990-0932-4ac0-a959-19d5cc630d94 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:03.330084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d132ab-5a91-43da-b20d-f0aee23c4774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:03.330084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d132ab-5a91-43da-b20d-f0aee23c4774 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.330084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d132ab-5a91-43da-b20d-f0aee23c4774 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.330084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d132ab-5a91-43da-b20d-f0aee23c4774 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.330685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d132ab-5a91-43da-b20d-f0aee23c4774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:03.330685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d132ab-5a91-43da-b20d-f0aee23c4774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:03.330685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d132ab-5a91-43da-b20d-f0aee23c4774 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:03.344242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 356/704] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:03.345371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d132ab-5a91-43da-b20d-f0aee23c4774 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:03.410186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 349/705] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:27:03 2022] POST /identity/v3/users => generated 254 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:03.411618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5811990-0932-4ac0-a959-19d5cc630d94 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:03.472397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:03.523865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d132ab-5a91-43da-b20d-f0aee23c4774 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:03.561027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:03.580287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6c31d-1f91-4fd0-b1ac-6f8691f7665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:03.581541 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6c31d-1f91-4fd0-b1ac-6f8691f7665b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.581939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6c31d-1f91-4fd0-b1ac-6f8691f7665b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.582323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6c31d-1f91-4fd0-b1ac-6f8691f7665b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.583342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6c31d-1f91-4fd0-b1ac-6f8691f7665b None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=45f676694ec24de2a5c755e217baed87) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:03.583790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6c31d-1f91-4fd0-b1ac-6f8691f7665b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:03.586139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6c31d-1f91-4fd0-b1ac-6f8691f7665b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:03.595954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 357/706] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:03 2022] GET /identity/v3/role_assignments?user.id=45f676694ec24de2a5c755e217baed87&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:03.597807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3379a59-dd74-4e73-8cdb-f690abe84085 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.598177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3379a59-dd74-4e73-8cdb-f690abe84085 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.599357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3379a59-dd74-4e73-8cdb-f690abe84085 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.602243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5811990-0932-4ac0-a959-19d5cc630d94 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:03.604395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 358/707] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:03.608172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af1307-f8d9-498f-8b3a-05af9a4b4b55 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.608542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af1307-f8d9-498f-8b3a-05af9a4b4b55 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.608755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af1307-f8d9-498f-8b3a-05af9a4b4b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.631844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c3af1307-f8d9-498f-8b3a-05af9a4b4b55 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:03.633102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c3af1307-f8d9-498f-8b3a-05af9a4b4b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:03.652249 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309003d2-fb21-4e76-86ec-3b2cb0073ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:03.653479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309003d2-fb21-4e76-86ec-3b2cb0073ebb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.653974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309003d2-fb21-4e76-86ec-3b2cb0073ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.654615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309003d2-fb21-4e76-86ec-3b2cb0073ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.663402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309003d2-fb21-4e76-86ec-3b2cb0073ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:03.665301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309003d2-fb21-4e76-86ec-3b2cb0073ebb None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-309003d2-fb21-4e76-86ec-3b2cb0073ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:03.681118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:03.682084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:03.682974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:03.682974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:03.682974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:03.682974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:03.682974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:03.682974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:03.682974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:03.682974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:03.685566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 350/708] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:03.693035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309003d2-fb21-4e76-86ec-3b2cb0073ebb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:03.738908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 359/709] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:27:03.764075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af1307-f8d9-498f-8b3a-05af9a4b4b55 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:03.814965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:03.846963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309003d2-fb21-4e76-86ec-3b2cb0073ebb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:03.894976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e4bbc-3552-4354-919f-8ad0eb6c6261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:03.896517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e4bbc-3552-4354-919f-8ad0eb6c6261 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.896984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e4bbc-3552-4354-919f-8ad0eb6c6261 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.897404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e4bbc-3552-4354-919f-8ad0eb6c6261 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.898336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e4bbc-3552-4354-919f-8ad0eb6c6261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:03.898788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e4bbc-3552-4354-919f-8ad0eb6c6261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:03.900436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e4bbc-3552-4354-919f-8ad0eb6c6261 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:03.920361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 351/710] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:03.920597 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af1307-f8d9-498f-8b3a-05af9a4b4b55 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:03.921610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e4bbc-3552-4354-919f-8ad0eb6c6261 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:03.940603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:03.970202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c9dd6-07d7-447f-b36e-a4912b688ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:03.971527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c9dd6-07d7-447f-b36e-a4912b688ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:03.971527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c9dd6-07d7-447f-b36e-a4912b688ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:03.971527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c9dd6-07d7-447f-b36e-a4912b688ee2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:03.972179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c9dd6-07d7-447f-b36e-a4912b688ee2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:03.975051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c9dd6-07d7-447f-b36e-a4912b688ee2 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-0a4c9dd6-07d7-447f-b36e-a4912b688ee2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:03.995379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:03.996468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:03.997303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 360/711] 10.222.0.74 () {56 vars in 1129 bytes} [Mon May 23 16:27:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:04.002615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c9dd6-07d7-447f-b36e-a4912b688ee2 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:04.044666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e4bbc-3552-4354-919f-8ad0eb6c6261 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:04.086111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1baa5-25c2-4402-b73a-d50f446bee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:04.086776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1baa5-25c2-4402-b73a-d50f446bee27 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:04.087058 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1baa5-25c2-4402-b73a-d50f446bee27 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:04.087331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1baa5-25c2-4402-b73a-d50f446bee27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:04.088166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1baa5-25c2-4402-b73a-d50f446bee27 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=951eca3289634609bcb684181e147ca3) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:04.088506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1baa5-25c2-4402-b73a-d50f446bee27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:04.089951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1baa5-25c2-4402-b73a-d50f446bee27 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:04.097928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 352/712] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:03 2022] GET /identity/v3/role_assignments?user.id=951eca3289634609bcb684181e147ca3&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:04.099829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ac9a0-c027-4dd9-b51f-dd70a7231301 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:04.100329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ac9a0-c027-4dd9-b51f-dd70a7231301 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:04.100456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ac9a0-c027-4dd9-b51f-dd70a7231301 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:04.104428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 353/713] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:04.107682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be87c9-e879-4c88-9f73-ca6804498e62 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:04.107979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be87c9-e879-4c88-9f73-ca6804498e62 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:04.108259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be87c9-e879-4c88-9f73-ca6804498e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:04.140053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-73be87c9-e879-4c88-9f73-ca6804498e62 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:04.142234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-73be87c9-e879-4c88-9f73-ca6804498e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:04.149980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c9dd6-07d7-447f-b36e-a4912b688ee2 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:04.152928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:04.197245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff12852-f03e-43aa-bfb0-ebb883e0cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:04.198009 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff12852-f03e-43aa-bfb0-ebb883e0cd7b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:04.198295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff12852-f03e-43aa-bfb0-ebb883e0cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:04.198572 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff12852-f03e-43aa-bfb0-ebb883e0cd7b None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:04.199304 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff12852-f03e-43aa-bfb0-ebb883e0cd7b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:04.199615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff12852-f03e-43aa-bfb0-ebb883e0cd7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:04.201132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff12852-f03e-43aa-bfb0-ebb883e0cd7b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:04.213621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 361/714] 10.222.0.74 () {56 vars in 1124 bytes} [Mon May 23 16:27:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:04.218501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff12852-f03e-43aa-bfb0-ebb883e0cd7b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:04.239242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 354/715] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:27:04.262658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be87c9-e879-4c88-9f73-ca6804498e62 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:04.321072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:04.376099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be87c9-e879-4c88-9f73-ca6804498e62 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:04.434984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6c1c1-2a38-4182-8a7f-c7ee38d8c3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:04.435806 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6c1c1-2a38-4182-8a7f-c7ee38d8c3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:04.436095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6c1c1-2a38-4182-8a7f-c7ee38d8c3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:04.436436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6c1c1-2a38-4182-8a7f-c7ee38d8c3b4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:04.439332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6c1c1-2a38-4182-8a7f-c7ee38d8c3b4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:04.440758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6c1c1-2a38-4182-8a7f-c7ee38d8c3b4 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:04.446847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff12852-f03e-43aa-bfb0-ebb883e0cd7b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-93d6c1c1-2a38-4182-8a7f-c7ee38d8c3b4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:04.466123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:04.467174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:27:04.468003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:04.468758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 355/716] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:04 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:04.475724 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6c1c1-2a38-4182-8a7f-c7ee38d8c3b4 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:04.478870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:04.525582 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad67c1f-b331-47c7-82e5-d03ec6f21827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:04.526533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad67c1f-b331-47c7-82e5-d03ec6f21827 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:04.526948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad67c1f-b331-47c7-82e5-d03ec6f21827 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:04.527366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad67c1f-b331-47c7-82e5-d03ec6f21827 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:04.528212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad67c1f-b331-47c7-82e5-d03ec6f21827 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:04.528700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad67c1f-b331-47c7-82e5-d03ec6f21827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:04.530210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad67c1f-b331-47c7-82e5-d03ec6f21827 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:04.544750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 362/717] 10.222.0.74 () {56 vars in 1124 bytes} [Mon May 23 16:27:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:04.608457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6c1c1-2a38-4182-8a7f-c7ee38d8c3b4 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:04.648062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f037b-eb94-4533-a343-f7d29f2fd2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:04.648864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f037b-eb94-4533-a343-f7d29f2fd2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:04.649250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f037b-eb94-4533-a343-f7d29f2fd2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:04.649647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f037b-eb94-4533-a343-f7d29f2fd2f5 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:04.650479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f037b-eb94-4533-a343-f7d29f2fd2f5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:04.650889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f037b-eb94-4533-a343-f7d29f2fd2f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:04.652405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f037b-eb94-4533-a343-f7d29f2fd2f5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:04.657956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 356/718] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:04.665415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad67c1f-b331-47c7-82e5-d03ec6f21827 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:04.888947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad67c1f-b331-47c7-82e5-d03ec6f21827 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:04.896792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:04.931772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf55c4-c38a-4aa5-bf1d-bbf45e070073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:04.932386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf55c4-c38a-4aa5-bf1d-bbf45e070073 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:04.932674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf55c4-c38a-4aa5-bf1d-bbf45e070073 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:04.932953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf55c4-c38a-4aa5-bf1d-bbf45e070073 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:04.933663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf55c4-c38a-4aa5-bf1d-bbf45e070073 None admin] RBAC: Adding query filter params (type=network) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:04.933967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf55c4-c38a-4aa5-bf1d-bbf45e070073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:04.935349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf55c4-c38a-4aa5-bf1d-bbf45e070073 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:04.940345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 363/719] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:06.501458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b8cb-7493-413c-9761-aa1409f08484 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:06.501962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b8cb-7493-413c-9761-aa1409f08484 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:06.501962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b8cb-7493-413c-9761-aa1409f08484 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:06.503566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 357/720] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:06.509451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8e2b-1178-4c3c-a224-85844efde722 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:06.509858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8e2b-1178-4c3c-a224-85844efde722 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:06.510052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8e2b-1178-4c3c-a224-85844efde722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:06.531016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-857c8e2b-1178-4c3c-a224-85844efde722 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:06.532215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-857c8e2b-1178-4c3c-a224-85844efde722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:06.634350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 364/721] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:27:06.644026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5ec86-4e6b-45ae-aa6d-553ee7b0555d None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:06.644345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5ec86-4e6b-45ae-aa6d-553ee7b0555d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:06.644631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5ec86-4e6b-45ae-aa6d-553ee7b0555d None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:06.647192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 358/722] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:06.652483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e30dc-4c79-453b-afd4-a00f7be38ee6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:06.652781 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e30dc-4c79-453b-afd4-a00f7be38ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:06.653063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e30dc-4c79-453b-afd4-a00f7be38ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:06.671490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a39e30dc-4c79-453b-afd4-a00f7be38ee6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:06.672720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a39e30dc-4c79-453b-afd4-a00f7be38ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:06.679788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5ec86-4e6b-45ae-aa6d-553ee7b0555d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:06.765872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 365/723] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:27:06.809357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:06.842001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e30dc-4c79-453b-afd4-a00f7be38ee6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:06.859394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5ec86-4e6b-45ae-aa6d-553ee7b0555d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:06.884658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:06.898101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0af2de-5958-4de2-a2fa-ce7234c128e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:06.898908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af2de-5958-4de2-a2fa-ce7234c128e7 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:06.899196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af2de-5958-4de2-a2fa-ce7234c128e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:06.899477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af2de-5958-4de2-a2fa-ce7234c128e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:06.910480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0af2de-5958-4de2-a2fa-ce7234c128e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-fc0af2de-5958-4de2-a2fa-ce7234c128e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:06.919602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:06.920665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:06.921534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 359/724] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:06.922746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881af02-c519-4f02-8ea6-defa6db9153e None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:06.922904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881af02-c519-4f02-8ea6-defa6db9153e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:06.923048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881af02-c519-4f02-8ea6-defa6db9153e None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:06.924575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 360/725] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:06.928037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881af02-c519-4f02-8ea6-defa6db9153e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:06.964797 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e30dc-4c79-453b-afd4-a00f7be38ee6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.002728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b206ab-3d12-45ef-b9a5-d400c7d3fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.003620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b206ab-3d12-45ef-b9a5-d400c7d3fa01 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.003928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b206ab-3d12-45ef-b9a5-d400c7d3fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.004254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b206ab-3d12-45ef-b9a5-d400c7d3fa01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.015190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b206ab-3d12-45ef-b9a5-d400c7d3fa01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-24b206ab-3d12-45ef-b9a5-d400c7d3fa01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:07.023629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:07.025352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 366/726] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:07.026855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e268-ba61-4c38-bf02-2152dc29c009 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.028189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e268-ba61-4c38-bf02-2152dc29c009 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.028189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e268-ba61-4c38-bf02-2152dc29c009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.054278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-3bf4e268-ba61-4c38-bf02-2152dc29c009 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:07.054495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881af02-c519-4f02-8ea6-defa6db9153e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.055624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3bf4e268-ba61-4c38-bf02-2152dc29c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:07.088458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:07.099763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a21b2e-0072-4744-be72-cd26728f685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.100963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a21b2e-0072-4744-be72-cd26728f685a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.101348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a21b2e-0072-4744-be72-cd26728f685a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.101725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a21b2e-0072-4744-be72-cd26728f685a None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.102873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a21b2e-0072-4744-be72-cd26728f685a None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:07.103364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a21b2e-0072-4744-be72-cd26728f685a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:07.105791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a21b2e-0072-4744-be72-cd26728f685a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:07.120496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 361/727] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:07.121710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a21b2e-0072-4744-be72-cd26728f685a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:07.162891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 367/728] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:27:07.163989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e268-ba61-4c38-bf02-2152dc29c009 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:07.206913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:07.267199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a21b2e-0072-4744-be72-cd26728f685a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.297877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e268-ba61-4c38-bf02-2152dc29c009 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.309324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0ff16-3aa4-4c73-a742-0a653af23a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.310004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0ff16-3aa4-4c73-a742-0a653af23a6c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.310344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0ff16-3aa4-4c73-a742-0a653af23a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.310624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0ff16-3aa4-4c73-a742-0a653af23a6c None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.311425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0ff16-3aa4-4c73-a742-0a653af23a6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:07.311737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0ff16-3aa4-4c73-a742-0a653af23a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:07.313194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0ff16-3aa4-4c73-a742-0a653af23a6c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:07.322998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 362/729] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:07.323616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0ff16-3aa4-4c73-a742-0a653af23a6c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:07.340173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318213db-786f-4167-a5a4-22a73d72bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.341005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318213db-786f-4167-a5a4-22a73d72bc8a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.341284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318213db-786f-4167-a5a4-22a73d72bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.341559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318213db-786f-4167-a5a4-22a73d72bc8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.352271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318213db-786f-4167-a5a4-22a73d72bc8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:07.353948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318213db-786f-4167-a5a4-22a73d72bc8a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-318213db-786f-4167-a5a4-22a73d72bc8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:07.373159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:07.374087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:07.374998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:07.374998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:07.374998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:07.374998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:07.376756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:07.377482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 368/730] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:07.379003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa369e8-e958-45b7-9258-bcbebfefa8a2 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.380154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa369e8-e958-45b7-9258-bcbebfefa8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.381029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa369e8-e958-45b7-9258-bcbebfefa8a2 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.382628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 369/731] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:07.383545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa369e8-e958-45b7-9258-bcbebfefa8a2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:07.445731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0ff16-3aa4-4c73-a742-0a653af23a6c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.477162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:07.485979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6111fb-40a8-446f-8c60-deadbfa8cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.487081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6111fb-40a8-446f-8c60-deadbfa8cd2b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.487539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6111fb-40a8-446f-8c60-deadbfa8cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.488052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6111fb-40a8-446f-8c60-deadbfa8cd2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.500450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6111fb-40a8-446f-8c60-deadbfa8cd2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:07.510630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa369e8-e958-45b7-9258-bcbebfefa8a2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-cf6111fb-40a8-446f-8c60-deadbfa8cd2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:07.511408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:07.512839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:07.513881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:07.522720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 363/732] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:07.522720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6111fb-40a8-446f-8c60-deadbfa8cd2b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:07.549817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc840-0eb6-4c61-b092-ecb5e0045139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.550525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc840-0eb6-4c61-b092-ecb5e0045139 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.550801 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc840-0eb6-4c61-b092-ecb5e0045139 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.551067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc840-0eb6-4c61-b092-ecb5e0045139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.561895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcc840-0eb6-4c61-b092-ecb5e0045139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:07.563337 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcc840-0eb6-4c61-b092-ecb5e0045139 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-41dcc840-0eb6-4c61-b092-ecb5e0045139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:07.581716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:07.582717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:07.583652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:07.583652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:07.583652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:07.583652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:07.583652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 370/733] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:07.584469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7dd6e-c1a8-4726-abe8-a2876e27cd19 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.584792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7dd6e-c1a8-4726-abe8-a2876e27cd19 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.585002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7dd6e-c1a8-4726-abe8-a2876e27cd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.601436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-50c7dd6e-c1a8-4726-abe8-a2876e27cd19 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:07.602601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-50c7dd6e-c1a8-4726-abe8-a2876e27cd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:07.643753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6111fb-40a8-446f-8c60-deadbfa8cd2b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.654718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:07.673733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 371/734] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:27:07.674578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7dd6e-c1a8-4726-abe8-a2876e27cd19 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:07.680220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434944c9-75c8-4f11-809d-489651e1b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.680918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434944c9-75c8-4f11-809d-489651e1b83a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.681208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434944c9-75c8-4f11-809d-489651e1b83a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.681483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434944c9-75c8-4f11-809d-489651e1b83a None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.682203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434944c9-75c8-4f11-809d-489651e1b83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:07.682510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434944c9-75c8-4f11-809d-489651e1b83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:07.683915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434944c9-75c8-4f11-809d-489651e1b83a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:07.697427 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 364/735] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:07.698261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434944c9-75c8-4f11-809d-489651e1b83a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:07.752268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:07.796255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7dd6e-c1a8-4726-abe8-a2876e27cd19 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.802591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434944c9-75c8-4f11-809d-489651e1b83a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.831881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d74ab6-3271-47c9-85e4-77ccb535826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.833150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d74ab6-3271-47c9-85e4-77ccb535826a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.833461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d74ab6-3271-47c9-85e4-77ccb535826a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.833746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d74ab6-3271-47c9-85e4-77ccb535826a None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.834498 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d74ab6-3271-47c9-85e4-77ccb535826a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:07.834807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d74ab6-3271-47c9-85e4-77ccb535826a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:07.835987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d78e8-7dfd-4c4f-b4e8-9a6adb0d47e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.836197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d74ab6-3271-47c9-85e4-77ccb535826a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:07.836677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d78e8-7dfd-4c4f-b4e8-9a6adb0d47e9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.836965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d78e8-7dfd-4c4f-b4e8-9a6adb0d47e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.837244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d78e8-7dfd-4c4f-b4e8-9a6adb0d47e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.838080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d78e8-7dfd-4c4f-b4e8-9a6adb0d47e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:07.838393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d78e8-7dfd-4c4f-b4e8-9a6adb0d47e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:07.839751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d78e8-7dfd-4c4f-b4e8-9a6adb0d47e9 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:07.844228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 372/736] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:07.845480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea302a9-7dc9-46b6-aa6b-ecadc340f89a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.845771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea302a9-7dc9-46b6-aa6b-ecadc340f89a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.846051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea302a9-7dc9-46b6-aa6b-ecadc340f89a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.847281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 373/737] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:07.847969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea302a9-7dc9-46b6-aa6b-ecadc340f89a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:07.856054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 365/738] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:07.857010 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d78e8-7dfd-4c4f-b4e8-9a6adb0d47e9 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:07.888758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:07.952184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea302a9-7dc9-46b6-aa6b-ecadc340f89a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.960203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d78e8-7dfd-4c4f-b4e8-9a6adb0d47e9 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:07.968386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:07.985199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df8be-bc6b-486f-99e4-fdf142542fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:07.985869 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df8be-bc6b-486f-99e4-fdf142542fca None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:07.986156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df8be-bc6b-486f-99e4-fdf142542fca None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:07.986438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df8be-bc6b-486f-99e4-fdf142542fca None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:07.987154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df8be-bc6b-486f-99e4-fdf142542fca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:07.988589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df8be-bc6b-486f-99e4-fdf142542fca None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:07.999195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda497c1-c949-475f-bfb2-73144ebe9b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:08.000001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda497c1-c949-475f-bfb2-73144ebe9b8d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.005709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda497c1-c949-475f-bfb2-73144ebe9b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.005709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda497c1-c949-475f-bfb2-73144ebe9b8d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.007877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda497c1-c949-475f-bfb2-73144ebe9b8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:08.009344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda497c1-c949-475f-bfb2-73144ebe9b8d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-dda497c1-c949-475f-bfb2-73144ebe9b8d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:08.024769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:08.025883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 366/739] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:27:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:08.031564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda497c1-c949-475f-bfb2-73144ebe9b8d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:08.072049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 374/740] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:27:07 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:08.073345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1cc65-5e1f-4615-9e59-c8c0c1ae55fa None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.073640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1cc65-5e1f-4615-9e59-c8c0c1ae55fa None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.073976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1cc65-5e1f-4615-9e59-c8c0c1ae55fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.101862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1fe1cc65-5e1f-4615-9e59-c8c0c1ae55fa None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:08.103188 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1fe1cc65-5e1f-4615-9e59-c8c0c1ae55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:08.128659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:08.139282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda497c1-c949-475f-bfb2-73144ebe9b8d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:08.191640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f71692-f357-4a53-9c38-7e245022be58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:08.192635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f71692-f357-4a53-9c38-7e245022be58 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.193202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 375/741] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 16:27:08.195100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1cc65-5e1f-4615-9e59-c8c0c1ae55fa None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:08.196851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f71692-f357-4a53-9c38-7e245022be58 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.197376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f71692-f357-4a53-9c38-7e245022be58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.217041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f71692-f357-4a53-9c38-7e245022be58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:08.218547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f71692-f357-4a53-9c38-7e245022be58 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-95f71692-f357-4a53-9c38-7e245022be58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:08.238112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:08.239372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:08.240285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:08.240285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:08.240285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:08.240285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:08.240285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 367/742] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:08.240285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f71692-f357-4a53-9c38-7e245022be58 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:08.317757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1cc65-5e1f-4615-9e59-c8c0c1ae55fa None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:08.319456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:08.353365 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f71692-f357-4a53-9c38-7e245022be58 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:08.355900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164f8fa-df3b-4175-a0ad-7f823a291263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:08.356659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164f8fa-df3b-4175-a0ad-7f823a291263 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.356939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164f8fa-df3b-4175-a0ad-7f823a291263 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.357214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164f8fa-df3b-4175-a0ad-7f823a291263 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.366004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164f8fa-df3b-4175-a0ad-7f823a291263 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:08.367857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164f8fa-df3b-4175-a0ad-7f823a291263 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-e164f8fa-df3b-4175-a0ad-7f823a291263 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:08.384954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:08.385965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 376/743] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:08.386974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164f8fa-df3b-4175-a0ad-7f823a291263 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:08.396337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f5036-dfb8-4a9c-94ec-09713605f189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:08.397009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f5036-dfb8-4a9c-94ec-09713605f189 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.397295 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f5036-dfb8-4a9c-94ec-09713605f189 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.397586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f5036-dfb8-4a9c-94ec-09713605f189 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.398414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f5036-dfb8-4a9c-94ec-09713605f189 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:08.398730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f5036-dfb8-4a9c-94ec-09713605f189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:08.400162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f5036-dfb8-4a9c-94ec-09713605f189 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:08.408997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:08.419802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 368/744] 10.222.0.74 () {56 vars in 1149 bytes} [Mon May 23 16:27:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:08.424325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f5036-dfb8-4a9c-94ec-09713605f189 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:08.497898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164f8fa-df3b-4175-a0ad-7f823a291263 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:08.533613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf8c5-8a3c-4230-8602-9730311c0694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:08.534455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf8c5-8a3c-4230-8602-9730311c0694 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.534706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f5036-dfb8-4a9c-94ec-09713605f189 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:08.535073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf8c5-8a3c-4230-8602-9730311c0694 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.535253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf8c5-8a3c-4230-8602-9730311c0694 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.536681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcf8c5-8a3c-4230-8602-9730311c0694 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:08.538149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcf8c5-8a3c-4230-8602-9730311c0694 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:08.570344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b98097-8d49-4411-8a31-1d70c65e7df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:08.571008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b98097-8d49-4411-8a31-1d70c65e7df1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.571293 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b98097-8d49-4411-8a31-1d70c65e7df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.571571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b98097-8d49-4411-8a31-1d70c65e7df1 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.572304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b98097-8d49-4411-8a31-1d70c65e7df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:08.572670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b98097-8d49-4411-8a31-1d70c65e7df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:08.574034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b98097-8d49-4411-8a31-1d70c65e7df1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:08.585984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 369/745] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:08.586790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b98097-8d49-4411-8a31-1d70c65e7df1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:08.610255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 377/746] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:27:08 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:08.617454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf8c5-8a3c-4230-8602-9730311c0694 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:08.652445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:08.658776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:08.707353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b98097-8d49-4411-8a31-1d70c65e7df1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:08.753987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cdba9-1c15-4051-907c-bb016421b507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:08.754728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cdba9-1c15-4051-907c-bb016421b507 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.755044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cdba9-1c15-4051-907c-bb016421b507 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.755278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cdba9-1c15-4051-907c-bb016421b507 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.756025 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf8c5-8a3c-4230-8602-9730311c0694 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:08.756224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cdba9-1c15-4051-907c-bb016421b507 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:08.756559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cdba9-1c15-4051-907c-bb016421b507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:08.758036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cdba9-1c15-4051-907c-bb016421b507 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:08.783954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 370/747] 10.222.0.74 () {56 vars in 1135 bytes} [Mon May 23 16:27:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:08.785184 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cdba9-1c15-4051-907c-bb016421b507 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:08.802100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1e152-db52-4b56-8b29-dd62f1141002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:08.803196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e152-db52-4b56-8b29-dd62f1141002 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.803712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e152-db52-4b56-8b29-dd62f1141002 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.804206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e152-db52-4b56-8b29-dd62f1141002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.890351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1e152-db52-4b56-8b29-dd62f1141002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:08.892437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1e152-db52-4b56-8b29-dd62f1141002 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:08.921471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cdba9-1c15-4051-907c-bb016421b507 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:08.932666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:08.935789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:08.966854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d577435-d1b0-461a-9222-5c119c877834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:08.968001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d577435-d1b0-461a-9222-5c119c877834 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:08.968527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d577435-d1b0-461a-9222-5c119c877834 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:08.969187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d577435-d1b0-461a-9222-5c119c877834 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:08.980257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d577435-d1b0-461a-9222-5c119c877834 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:08.981747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d577435-d1b0-461a-9222-5c119c877834 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-5d577435-d1b0-461a-9222-5c119c877834 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:09.000554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:09.001569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 371/748] 10.222.0.74 () {56 vars in 1093 bytes} [Mon May 23 16:27:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:09.003094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d577435-d1b0-461a-9222-5c119c877834 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.021763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 378/749] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:27:09.022893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1e152-db52-4b56-8b29-dd62f1141002 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.119931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d577435-d1b0-461a-9222-5c119c877834 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:09.134208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1e152-db52-4b56-8b29-dd62f1141002 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:09.157331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21bd4-d5d3-4bbc-951b-21809cc04509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:09.157855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21bd4-d5d3-4bbc-951b-21809cc04509 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:09.158145 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21bd4-d5d3-4bbc-951b-21809cc04509 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:09.158423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21bd4-d5d3-4bbc-951b-21809cc04509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:09.161574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:09.174348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98a3d2-d9f3-48f7-9d24-5b20ad636a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:09.178824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a3d2-d9f3-48f7-9d24-5b20ad636a99 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:09.178824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a3d2-d9f3-48f7-9d24-5b20ad636a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:09.178824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a3d2-d9f3-48f7-9d24-5b20ad636a99 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:09.178824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a3d2-d9f3-48f7-9d24-5b20ad636a99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:09.178824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a3d2-d9f3-48f7-9d24-5b20ad636a99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:09.179693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a3d2-d9f3-48f7-9d24-5b20ad636a99 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:09.200181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 379/750] 10.222.0.74 () {56 vars in 1133 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:09.201485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98a3d2-d9f3-48f7-9d24-5b20ad636a99 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.202174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:09.240105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b21bd4-d5d3-4bbc-951b-21809cc04509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:09.241633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b21bd4-d5d3-4bbc-951b-21809cc04509 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:09.311359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98a3d2-d9f3-48f7-9d24-5b20ad636a99 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:09.353696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 372/751] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:27:09.353696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21bd4-d5d3-4bbc-951b-21809cc04509 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.354626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80ebfd-2dd6-4106-9588-cb31ccba0df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:09.356133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80ebfd-2dd6-4106-9588-cb31ccba0df9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:09.356638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80ebfd-2dd6-4106-9588-cb31ccba0df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:09.357115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80ebfd-2dd6-4106-9588-cb31ccba0df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:09.369411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80ebfd-2dd6-4106-9588-cb31ccba0df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:09.371322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80ebfd-2dd6-4106-9588-cb31ccba0df9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-bf80ebfd-2dd6-4106-9588-cb31ccba0df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:09.391566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:09.392560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:09.393712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:09.393712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:09.393712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:09.393712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:09.400661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 380/752] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:09.401734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80ebfd-2dd6-4106-9588-cb31ccba0df9 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.424503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:09.433921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:09.457762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21bd4-d5d3-4bbc-951b-21809cc04509 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:09.495701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a8aba-ae06-4044-98cc-e239a9aefda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:09.496523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8aba-ae06-4044-98cc-e239a9aefda1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:09.496803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8aba-ae06-4044-98cc-e239a9aefda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:09.497075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8aba-ae06-4044-98cc-e239a9aefda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:09.508547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a8aba-ae06-4044-98cc-e239a9aefda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:09.509171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80ebfd-2dd6-4106-9588-cb31ccba0df9 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:09.510144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a8aba-ae06-4044-98cc-e239a9aefda1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-d38a8aba-ae06-4044-98cc-e239a9aefda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:09.530227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:09.531175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:09.532101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:09.532101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:09.532101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:09.532101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:09.536636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 373/753] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:09.537575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a8aba-ae06-4044-98cc-e239a9aefda1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.550907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d865f-9332-40a8-873a-afa8e86a5e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:09.552425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d865f-9332-40a8-873a-afa8e86a5e94 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:09.552910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d865f-9332-40a8-873a-afa8e86a5e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:09.553418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d865f-9332-40a8-873a-afa8e86a5e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:09.564151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d865f-9332-40a8-873a-afa8e86a5e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:09.565951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d865f-9332-40a8-873a-afa8e86a5e94 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-122d865f-9332-40a8-873a-afa8e86a5e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:09.584822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:09.585716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:09.586612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:09.586612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:09.586612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:09.586612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:09.588883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 381/754] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:09.589870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d865f-9332-40a8-873a-afa8e86a5e94 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.651716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a8aba-ae06-4044-98cc-e239a9aefda1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:09.678165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:09.678944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:09.691105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12838ecb-51b0-48e8-855c-e4ab066995ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:09.691895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838ecb-51b0-48e8-855c-e4ab066995ac None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:09.692209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838ecb-51b0-48e8-855c-e4ab066995ac None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:09.692488 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838ecb-51b0-48e8-855c-e4ab066995ac None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:09.693237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12838ecb-51b0-48e8-855c-e4ab066995ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:09.693543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12838ecb-51b0-48e8-855c-e4ab066995ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:09.695104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12838ecb-51b0-48e8-855c-e4ab066995ac None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:09.697448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d865f-9332-40a8-873a-afa8e86a5e94 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:09.709030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 374/755] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:09.709030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12838ecb-51b0-48e8-855c-e4ab066995ac None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.827128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12838ecb-51b0-48e8-855c-e4ab066995ac None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:09.870988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375f2e-9113-4ba5-93fa-8f0f9deaa3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:09.871996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375f2e-9113-4ba5-93fa-8f0f9deaa3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:09.872661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375f2e-9113-4ba5-93fa-8f0f9deaa3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:09.873123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375f2e-9113-4ba5-93fa-8f0f9deaa3f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:09.873896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93890-ee07-4ff2-83d2-951cb50956cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:09.874031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6375f2e-9113-4ba5-93fa-8f0f9deaa3f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:09.874433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6375f2e-9113-4ba5-93fa-8f0f9deaa3f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:09.874986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93890-ee07-4ff2-83d2-951cb50956cb None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:09.875404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93890-ee07-4ff2-83d2-951cb50956cb None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:09.875814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93890-ee07-4ff2-83d2-951cb50956cb None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:09.876095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6375f2e-9113-4ba5-93fa-8f0f9deaa3f3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:09.876864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93890-ee07-4ff2-83d2-951cb50956cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:09.877308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93890-ee07-4ff2-83d2-951cb50956cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:09.879596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93890-ee07-4ff2-83d2-951cb50956cb None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:09.890379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 375/756] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:09.891799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375f2e-9113-4ba5-93fa-8f0f9deaa3f3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.894460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 382/757] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:09.896570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93890-ee07-4ff2-83d2-951cb50956cb None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:09.949374 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:10.020430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93890-ee07-4ff2-83d2-951cb50956cb None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.024991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375f2e-9113-4ba5-93fa-8f0f9deaa3f3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.057578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24745f-97cb-4f6d-9711-966329d9961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:10.058715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24745f-97cb-4f6d-9711-966329d9961f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.059161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24745f-97cb-4f6d-9711-966329d9961f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.059583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24745f-97cb-4f6d-9711-966329d9961f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.066531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243f3b-79b9-44a8-bf49-1aac1a30b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:10.067796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24745f-97cb-4f6d-9711-966329d9961f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:10.067922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243f3b-79b9-44a8-bf49-1aac1a30b309 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.068150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243f3b-79b9-44a8-bf49-1aac1a30b309 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.068449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243f3b-79b9-44a8-bf49-1aac1a30b309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.069856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24745f-97cb-4f6d-9711-966329d9961f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:10.076059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243f3b-79b9-44a8-bf49-1aac1a30b309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:10.077815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243f3b-79b9-44a8-bf49-1aac1a30b309 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-4c24745f-97cb-4f6d-9711-966329d9961f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:10.085480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:10.086562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:10.087600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:10.087600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:10.087600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:10.087600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:10.087600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:10.087600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:10.087600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:10.087600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:10.089656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 383/758] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:10.090568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24745f-97cb-4f6d-9711-966329d9961f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-ca243f3b-79b9-44a8-bf49-1aac1a30b309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:10.092088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:10.092990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:10.093903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:10.093903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:10.093903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:10.093903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:10.093903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:10.093903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:10.093903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:10.093903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:10.093903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 376/759] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:10.094800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243f3b-79b9-44a8-bf49-1aac1a30b309 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:10.099063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:10.210629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243f3b-79b9-44a8-bf49-1aac1a30b309 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.213604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:10.225394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24745f-97cb-4f6d-9711-966329d9961f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.249101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ca86-28cb-4fd9-8db8-cbf75fad42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:10.249920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ca86-28cb-4fd9-8db8-cbf75fad42fb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.250510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ca86-28cb-4fd9-8db8-cbf75fad42fb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.250631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ca86-28cb-4fd9-8db8-cbf75fad42fb None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.251534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ca86-28cb-4fd9-8db8-cbf75fad42fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:10.251947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ca86-28cb-4fd9-8db8-cbf75fad42fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:10.253599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ca86-28cb-4fd9-8db8-cbf75fad42fb None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:10.262398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1528-581a-4612-b9a4-d2baca5f8ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:10.263384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1528-581a-4612-b9a4-d2baca5f8ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.263806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1528-581a-4612-b9a4-d2baca5f8ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.264236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1528-581a-4612-b9a4-d2baca5f8ca5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.269126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 377/760] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:10.270664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ca86-28cb-4fd9-8db8-cbf75fad42fb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:10.272844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa1528-581a-4612-b9a4-d2baca5f8ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:10.274456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa1528-581a-4612-b9a4-d2baca5f8ca5 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-15fa1528-581a-4612-b9a4-d2baca5f8ca5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:10.289515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:10.290427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:10.291305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:10.291305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:10.291305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:10.291305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:10.291305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:10.291305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:10.291305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:10.291305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:10.293838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 384/761] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:10.294785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1528-581a-4612-b9a4-d2baca5f8ca5 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:10.359740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:10.381623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ca86-28cb-4fd9-8db8-cbf75fad42fb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.400755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1528-581a-4612-b9a4-d2baca5f8ca5 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.418559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25d49d-611a-4ae9-9f4d-bf8b0274f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:10.419222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25d49d-611a-4ae9-9f4d-bf8b0274f416 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.419510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25d49d-611a-4ae9-9f4d-bf8b0274f416 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.419788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25d49d-611a-4ae9-9f4d-bf8b0274f416 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.420618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25d49d-611a-4ae9-9f4d-bf8b0274f416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:10.420973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25d49d-611a-4ae9-9f4d-bf8b0274f416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:10.422423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25d49d-611a-4ae9-9f4d-bf8b0274f416 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:10.436564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c239b99-28d9-492e-b7c8-2ee8088dcd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:10.437227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239b99-28d9-492e-b7c8-2ee8088dcd85 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.437511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239b99-28d9-492e-b7c8-2ee8088dcd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.437790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239b99-28d9-492e-b7c8-2ee8088dcd85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.438621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c239b99-28d9-492e-b7c8-2ee8088dcd85 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=45f676694ec24de2a5c755e217baed87) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:10.438980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c239b99-28d9-492e-b7c8-2ee8088dcd85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:10.440530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c239b99-28d9-492e-b7c8-2ee8088dcd85 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:10.442334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 378/762] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:10.443446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25d49d-611a-4ae9-9f4d-bf8b0274f416 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:10.447570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 385/763] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:10 2022] GET /identity/v3/role_assignments?user.id=45f676694ec24de2a5c755e217baed87&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:10.448560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f915c13-6d60-4782-b1a4-746587322327 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.448849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f915c13-6d60-4782-b1a4-746587322327 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.449129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f915c13-6d60-4782-b1a4-746587322327 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.450702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 386/764] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:10.451502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f915c13-6d60-4782-b1a4-746587322327 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:10.478211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:10.573862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f915c13-6d60-4782-b1a4-746587322327 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.595421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25d49d-611a-4ae9-9f4d-bf8b0274f416 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.606558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:10.617824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e617e-654a-495f-b5ce-5771dd5cd760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:10.618597 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e617e-654a-495f-b5ce-5771dd5cd760 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.618951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e617e-654a-495f-b5ce-5771dd5cd760 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.619308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e617e-654a-495f-b5ce-5771dd5cd760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.620245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e617e-654a-495f-b5ce-5771dd5cd760 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=d673b38649fe44059ae0257df02ed61f) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:10.620716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e617e-654a-495f-b5ce-5771dd5cd760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:10.622491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e617e-654a-495f-b5ce-5771dd5cd760 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:10.629220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 387/765] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:10 2022] GET /identity/v3/role_assignments?user.id=d673b38649fe44059ae0257df02ed61f&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:10.630943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3168-f42a-4078-83b2-5272a6138774 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.631535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3168-f42a-4078-83b2-5272a6138774 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.631535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3168-f42a-4078-83b2-5272a6138774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.641150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9228d49-1ea7-4b81-9a95-63f583b0d6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:10.642114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9228d49-1ea7-4b81-9a95-63f583b0d6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.642574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9228d49-1ea7-4b81-9a95-63f583b0d6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.643081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9228d49-1ea7-4b81-9a95-63f583b0d6e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.644105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9228d49-1ea7-4b81-9a95-63f583b0d6e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:10.644647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9228d49-1ea7-4b81-9a95-63f583b0d6e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:10.646891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9228d49-1ea7-4b81-9a95-63f583b0d6e9 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:10.652935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0e1e3168-f42a-4078-83b2-5272a6138774 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:10.654183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0e1e3168-f42a-4078-83b2-5272a6138774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:10.663516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 379/766] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:10.672324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9228d49-1ea7-4b81-9a95-63f583b0d6e9 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:10.744457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 388/767] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:10.776810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3168-f42a-4078-83b2-5272a6138774 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:10.860682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:10.896326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9228d49-1ea7-4b81-9a95-63f583b0d6e9 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.936742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6186d69-7e9c-4e13-959e-5386eec95f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:10.937743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186d69-7e9c-4e13-959e-5386eec95f6c None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:10.938029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186d69-7e9c-4e13-959e-5386eec95f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:10.938308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186d69-7e9c-4e13-959e-5386eec95f6c None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/951eca3289634609bcb684181e147ca3/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:10.940481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186d69-7e9c-4e13-959e-5386eec95f6c None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=951eca3289634609bcb684181e147ca3, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:10.942674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186d69-7e9c-4e13-959e-5386eec95f6c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:10.971412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3168-f42a-4078-83b2-5272a6138774 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:10.999159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:11.011150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6e9e3-3013-4ab5-bf93-fddbe83ac629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:11.025021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e9e3-3013-4ab5-bf93-fddbe83ac629 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:11.025021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e9e3-3013-4ab5-bf93-fddbe83ac629 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:11.025021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e9e3-3013-4ab5-bf93-fddbe83ac629 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:11.025021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6e9e3-3013-4ab5-bf93-fddbe83ac629 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:11.025021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6e9e3-3013-4ab5-bf93-fddbe83ac629 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:11.025384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 380/768] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:27:10 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/951eca3289634609bcb684181e147ca3/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:11.025384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc76eb-2b0f-4d0b-b614-3936bccd90c3 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:11.025384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc76eb-2b0f-4d0b-b614-3936bccd90c3 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:11.025384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc76eb-2b0f-4d0b-b614-3936bccd90c3 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:11.027306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 381/769] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-3af6e9e3-3013-4ab5-bf93-fddbe83ac629 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:11.031711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:11.032777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:11.033648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 389/770] 10.222.0.74 () {56 vars in 1129 bytes} [Mon May 23 16:27:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:11.034479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca9f7e-a5a3-489a-b304-e84e8cb82f7d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:11.034479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca9f7e-a5a3-489a-b304-e84e8cb82f7d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:11.034479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca9f7e-a5a3-489a-b304-e84e8cb82f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:11.037006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc76eb-2b0f-4d0b-b614-3936bccd90c3 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:11.075779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-00ca9f7e-a5a3-489a-b304-e84e8cb82f7d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:11.077348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-00ca9f7e-a5a3-489a-b304-e84e8cb82f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:11.216981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc76eb-2b0f-4d0b-b614-3936bccd90c3 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:11.243371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 390/771] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:11.255542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455f250-cdf2-4629-b262-32261c0798db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:11.256268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455f250-cdf2-4629-b262-32261c0798db None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:11.256646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455f250-cdf2-4629-b262-32261c0798db None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:11.256925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455f250-cdf2-4629-b262-32261c0798db None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:11.257644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455f250-cdf2-4629-b262-32261c0798db None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:11.258008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455f250-cdf2-4629-b262-32261c0798db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:11.259445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455f250-cdf2-4629-b262-32261c0798db None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:11.264960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 382/772] 10.222.0.74 () {56 vars in 1124 bytes} [Mon May 23 16:27:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:11.271078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca9f7e-a5a3-489a-b304-e84e8cb82f7d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:11.279629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455f250-cdf2-4629-b262-32261c0798db None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:11.297888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:11.408874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca9f7e-a5a3-489a-b304-e84e8cb82f7d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:11.417059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455f250-cdf2-4629-b262-32261c0798db None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:11.429212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:11.456525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253a640-202b-4511-b28f-a3b53682eb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:11.457782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253a640-202b-4511-b28f-a3b53682eb3b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:11.458421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253a640-202b-4511-b28f-a3b53682eb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:11.458757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253a640-202b-4511-b28f-a3b53682eb3b None admin] PATH_INFO: `/v3/services/network` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:11.459420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253a640-202b-4511-b28f-a3b53682eb3b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:11.460818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253a640-202b-4511-b28f-a3b53682eb3b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:11.466738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394d79a-eb13-4001-af95-8f9c69fd1135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:11.467412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394d79a-eb13-4001-af95-8f9c69fd1135 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:11.467693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394d79a-eb13-4001-af95-8f9c69fd1135 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:11.467966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394d79a-eb13-4001-af95-8f9c69fd1135 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:11.468705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394d79a-eb13-4001-af95-8f9c69fd1135 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:11.469010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394d79a-eb13-4001-af95-8f9c69fd1135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:11.470365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394d79a-eb13-4001-af95-8f9c69fd1135 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-3253a640-202b-4511-b28f-a3b53682eb3b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:11.473544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:11.474568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:11.475426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 383/773] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:11 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:11.482392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253a640-202b-4511-b28f-a3b53682eb3b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:11.491318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 391/774] 10.222.0.74 () {56 vars in 1124 bytes} [Mon May 23 16:27:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:11.497224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394d79a-eb13-4001-af95-8f9c69fd1135 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:11.561659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:11.599414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253a640-202b-4511-b28f-a3b53682eb3b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:11.639079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f66ce-a408-4ffb-bc37-a5a236158164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:11.640116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f66ce-a408-4ffb-bc37-a5a236158164 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:11.640637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f66ce-a408-4ffb-bc37-a5a236158164 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:11.641356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f66ce-a408-4ffb-bc37-a5a236158164 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:11.642281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f66ce-a408-4ffb-bc37-a5a236158164 None admin] RBAC: Adding query filter params (name=network) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:11.642810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f66ce-a408-4ffb-bc37-a5a236158164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:11.644486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f66ce-a408-4ffb-bc37-a5a236158164 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:11.650780 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 384/775] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:11.657162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f66ce-a408-4ffb-bc37-a5a236158164 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:11.735229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394d79a-eb13-4001-af95-8f9c69fd1135 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:11.793528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaba4b-a7fd-46ae-816e-6066f2abf73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:11.794197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaba4b-a7fd-46ae-816e-6066f2abf73b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:11.794476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaba4b-a7fd-46ae-816e-6066f2abf73b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:11.794751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaba4b-a7fd-46ae-816e-6066f2abf73b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:11.795545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaba4b-a7fd-46ae-816e-6066f2abf73b None admin] RBAC: Adding query filter params (interface=public, service_id=33dfedac94cf4c64959d4aef762e69db, region_id=RegionOne) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:11.795854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaba4b-a7fd-46ae-816e-6066f2abf73b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:11.797257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaba4b-a7fd-46ae-816e-6066f2abf73b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:11.819510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 392/776] 10.222.0.74 () {56 vars in 1251 bytes} [Mon May 23 16:27:11 2022] GET /identity/v3/endpoints?service_id=33dfedac94cf4c64959d4aef762e69db&interface=public®ion_id=RegionOne => generated 194 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:11.821188 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaba4b-a7fd-46ae-816e-6066f2abf73b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:11.839311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f66ce-a408-4ffb-bc37-a5a236158164 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:11.895978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246b8d0-acd7-4e8c-8ad5-93be2b68aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:11.896671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246b8d0-acd7-4e8c-8ad5-93be2b68aa26 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:11.896803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:11.896958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246b8d0-acd7-4e8c-8ad5-93be2b68aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:11.897232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246b8d0-acd7-4e8c-8ad5-93be2b68aa26 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:11.897942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246b8d0-acd7-4e8c-8ad5-93be2b68aa26 None admin] RBAC: Adding query filter params (type=network) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:11.898247 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246b8d0-acd7-4e8c-8ad5-93be2b68aa26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:11.899629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246b8d0-acd7-4e8c-8ad5-93be2b68aa26 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:11.902610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:11.916309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 385/777] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:11.922011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246b8d0-acd7-4e8c-8ad5-93be2b68aa26 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:11.976914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaba4b-a7fd-46ae-816e-6066f2abf73b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:12.026334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527006c-883f-437b-ae70-e3f951728287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:12.027019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527006c-883f-437b-ae70-e3f951728287 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:12.027302 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527006c-883f-437b-ae70-e3f951728287 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:12.027578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527006c-883f-437b-ae70-e3f951728287 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:12.028271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527006c-883f-437b-ae70-e3f951728287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:12.032504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527006c-883f-437b-ae70-e3f951728287 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:12.045574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 393/778] 10.222.0.74 () {56 vars in 1087 bytes} [Mon May 23 16:27:11 2022] GET /identity/v3/services => generated 772 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:12.111065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246b8d0-acd7-4e8c-8ad5-93be2b68aa26 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:12.150626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eab3d-29e4-4f39-ae2c-40139a123ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:12.151356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eab3d-29e4-4f39-ae2c-40139a123ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:12.151639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eab3d-29e4-4f39-ae2c-40139a123ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:12.151964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eab3d-29e4-4f39-ae2c-40139a123ad3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:12.152794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eab3d-29e4-4f39-ae2c-40139a123ad3 None admin] RBAC: Adding query filter params (interface=public, service_id=79a5832f9bf941dbb7cb707193e33391, region_id=RegionOne) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:12.153105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eab3d-29e4-4f39-ae2c-40139a123ad3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:12.154474 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eab3d-29e4-4f39-ae2c-40139a123ad3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:12.163402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 386/779] 10.222.0.74 () {56 vars in 1251 bytes} [Mon May 23 16:27:11 2022] GET /identity/v3/endpoints?service_id=79a5832f9bf941dbb7cb707193e33391&interface=public®ion_id=RegionOne => generated 194 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:12.169043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527006c-883f-437b-ae70-e3f951728287 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:12.317202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527006c-883f-437b-ae70-e3f951728287 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:12.330430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:12.362515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694502b2-d0e9-4f34-bea8-f1f3ac9f5a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:12.363143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694502b2-d0e9-4f34-bea8-f1f3ac9f5a40 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:12.363463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694502b2-d0e9-4f34-bea8-f1f3ac9f5a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:12.364455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694502b2-d0e9-4f34-bea8-f1f3ac9f5a40 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:12.365178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694502b2-d0e9-4f34-bea8-f1f3ac9f5a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:12.366591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694502b2-d0e9-4f34-bea8-f1f3ac9f5a40 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:12.372338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 394/780] 10.222.0.74 () {56 vars in 1087 bytes} [Mon May 23 16:27:12 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:12.891703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb74d-a6a2-49c9-af47-7ea644ac0aef None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:12.892223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb74d-a6a2-49c9-af47-7ea644ac0aef None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:12.892356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb74d-a6a2-49c9-af47-7ea644ac0aef None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:12.893912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 387/781] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:12.900096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d884-f81a-46ea-a491-102279e0b633 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:12.900570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d884-f81a-46ea-a491-102279e0b633 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:12.900768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d884-f81a-46ea-a491-102279e0b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:12.917907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-53a1d884-f81a-46ea-a491-102279e0b633 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:12.919146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-53a1d884-f81a-46ea-a491-102279e0b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:13.018959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 395/782] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:13.056053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbb74d-a6a2-49c9-af47-7ea644ac0aef None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:13.158831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:13.234504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbb74d-a6a2-49c9-af47-7ea644ac0aef None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:13.290876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6687160-b5b2-4c74-8539-73b07c20bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:13.291670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6687160-b5b2-4c74-8539-73b07c20bf8a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:13.291951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6687160-b5b2-4c74-8539-73b07c20bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:13.292218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6687160-b5b2-4c74-8539-73b07c20bf8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:13.294036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ce119-80fd-4b57-941b-96e8acd0366a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:13.294326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ce119-80fd-4b57-941b-96e8acd0366a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:13.294602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ce119-80fd-4b57-941b-96e8acd0366a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:13.296169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 396/783] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:13.302953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20787f6-a1fb-4020-bb6b-2c2a5c5a2522 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:13.303487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20787f6-a1fb-4020-bb6b-2c2a5c5a2522 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:13.303965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20787f6-a1fb-4020-bb6b-2c2a5c5a2522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:13.308788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6687160-b5b2-4c74-8539-73b07c20bf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-b6687160-b5b2-4c74-8539-73b07c20bf8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:13.316446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:13.317937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:13.323823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 388/784] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:13.327803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6687160-b5b2-4c74-8539-73b07c20bf8a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:13.331244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-e20787f6-a1fb-4020-bb6b-2c2a5c5a2522 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:13.333260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e20787f6-a1fb-4020-bb6b-2c2a5c5a2522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:13.417958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 397/785] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:13.437435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20787f6-a1fb-4020-bb6b-2c2a5c5a2522 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:13.520385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6687160-b5b2-4c74-8539-73b07c20bf8a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:13.524731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:13.545605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:13.558981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062d68d-d32d-4968-863e-f2f1a87ed25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:13.560009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062d68d-d32d-4968-863e-f2f1a87ed25a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:13.560544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062d68d-d32d-4968-863e-f2f1a87ed25a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:13.561023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062d68d-d32d-4968-863e-f2f1a87ed25a None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:13.561988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062d68d-d32d-4968-863e-f2f1a87ed25a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:13.562515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062d68d-d32d-4968-863e-f2f1a87ed25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:13.564504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062d68d-d32d-4968-863e-f2f1a87ed25a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:13.579624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 389/786] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:13.581167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062d68d-d32d-4968-863e-f2f1a87ed25a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:13.618183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20787f6-a1fb-4020-bb6b-2c2a5c5a2522 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:13.662809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93373854-62c8-4566-bb20-fe3f56db3f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:13.663972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93373854-62c8-4566-bb20-fe3f56db3f24 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:13.664688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93373854-62c8-4566-bb20-fe3f56db3f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:13.665666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93373854-62c8-4566-bb20-fe3f56db3f24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:13.680077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93373854-62c8-4566-bb20-fe3f56db3f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-93373854-62c8-4566-bb20-fe3f56db3f24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:13.690628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:13.692245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:27:13.693232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:13.699270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 398/787] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:13.705361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93373854-62c8-4566-bb20-fe3f56db3f24 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:13.724761 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062d68d-d32d-4968-863e-f2f1a87ed25a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:13.773844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d50ded-e6cf-4ed0-b749-db1fd53b6fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:13.775020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d50ded-e6cf-4ed0-b749-db1fd53b6fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:13.775507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d50ded-e6cf-4ed0-b749-db1fd53b6fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:13.776253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d50ded-e6cf-4ed0-b749-db1fd53b6fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:13.799301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d50ded-e6cf-4ed0-b749-db1fd53b6fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:13.801292 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d50ded-e6cf-4ed0-b749-db1fd53b6fd3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-a9d50ded-e6cf-4ed0-b749-db1fd53b6fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:13.833171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:13.834191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:13.835503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:13.835503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:13.835503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:13.835503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:13.835503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 390/788] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:13.845132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d50ded-e6cf-4ed0-b749-db1fd53b6fd3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:13.882249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:13.899675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93373854-62c8-4566-bb20-fe3f56db3f24 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:13.918791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:13.964991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494f36b-544a-4fff-984d-8b05cd6ebe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:13.965583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494f36b-544a-4fff-984d-8b05cd6ebe7a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:13.965873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494f36b-544a-4fff-984d-8b05cd6ebe7a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:13.966155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494f36b-544a-4fff-984d-8b05cd6ebe7a None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:13.966916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494f36b-544a-4fff-984d-8b05cd6ebe7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:13.967224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494f36b-544a-4fff-984d-8b05cd6ebe7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:13.968668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494f36b-544a-4fff-984d-8b05cd6ebe7a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:13.979654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 399/789] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:13.981283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bb3ba-6e48-457c-83af-10b3ba483127 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:13.981579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bb3ba-6e48-457c-83af-10b3ba483127 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:13.981861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bb3ba-6e48-457c-83af-10b3ba483127 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:13.987592 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 400/790] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:13.989649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bb3ba-6e48-457c-83af-10b3ba483127 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.002619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d50ded-e6cf-4ed0-b749-db1fd53b6fd3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.039425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00ed00-ff67-457c-be18-a4e59ccb3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.040351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00ed00-ff67-457c-be18-a4e59ccb3f9a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.040777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00ed00-ff67-457c-be18-a4e59ccb3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.041292 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00ed00-ff67-457c-be18-a4e59ccb3f9a None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.042152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00ed00-ff67-457c-be18-a4e59ccb3f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:14.042597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00ed00-ff67-457c-be18-a4e59ccb3f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:14.044097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00ed00-ff67-457c-be18-a4e59ccb3f9a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:14.057557 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 391/791] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:14.059092 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19e49b-2759-4ec0-a809-d8a630b5a919 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.059519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19e49b-2759-4ec0-a809-d8a630b5a919 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.059937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19e49b-2759-4ec0-a809-d8a630b5a919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.077316 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5e19e49b-2759-4ec0-a809-d8a630b5a919 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:14.078513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5e19e49b-2759-4ec0-a809-d8a630b5a919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:14.115629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bb3ba-6e48-457c-83af-10b3ba483127 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.154671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f5ddd-ede4-41eb-a308-66e87aff62d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.155975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f5ddd-ede4-41eb-a308-66e87aff62d0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.156580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f5ddd-ede4-41eb-a308-66e87aff62d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.157064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f5ddd-ede4-41eb-a308-66e87aff62d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.161452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 392/792] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:14.162375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19e49b-2759-4ec0-a809-d8a630b5a919 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.182432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f5ddd-ede4-41eb-a308-66e87aff62d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:14.184536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f5ddd-ede4-41eb-a308-66e87aff62d0 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:14.199755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-3b0f5ddd-ede4-41eb-a308-66e87aff62d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:14.207571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:14.208476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:14.209388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:14.209388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:14.209388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:14.209388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:14.211594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 401/793] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:14.212743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f5ddd-ede4-41eb-a308-66e87aff62d0 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.223162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:14.300521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19e49b-2759-4ec0-a809-d8a630b5a919 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.321666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f5ddd-ede4-41eb-a308-66e87aff62d0 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.343612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850b84-5061-4702-ad4a-73d11a848fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.344921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850b84-5061-4702-ad4a-73d11a848fdc None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.345207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850b84-5061-4702-ad4a-73d11a848fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.345482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850b84-5061-4702-ad4a-73d11a848fdc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.356023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31850b84-5061-4702-ad4a-73d11a848fdc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:14.357728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31850b84-5061-4702-ad4a-73d11a848fdc None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:14.360573 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12e0ee-19f0-4181-ae82-9d85c4bce7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.361641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12e0ee-19f0-4181-ae82-9d85c4bce7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.362129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12e0ee-19f0-4181-ae82-9d85c4bce7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.362989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12e0ee-19f0-4181-ae82-9d85c4bce7a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-31850b84-5061-4702-ad4a-73d11a848fdc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:14.375400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:14.376411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:27:14.377387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:14.380521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 393/794] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:14.381686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850b84-5061-4702-ad4a-73d11a848fdc None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.382389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12e0ee-19f0-4181-ae82-9d85c4bce7a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-5f12e0ee-19f0-4181-ae82-9d85c4bce7a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:14.390943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:14.392103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:14.393058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:14.399657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 402/795] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:14.399657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12e0ee-19f0-4181-ae82-9d85c4bce7a1 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.482552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:14.500078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:14.518802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850b84-5061-4702-ad4a-73d11a848fdc None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.522458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12e0ee-19f0-4181-ae82-9d85c4bce7a1 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.565383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ec81-6cb1-4ddf-be51-4f390a1a1189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.567432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ec81-6cb1-4ddf-be51-4f390a1a1189 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.568329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff28c6-706b-4ef2-914d-3dfac2e455ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.568704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ec81-6cb1-4ddf-be51-4f390a1a1189 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.568996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ec81-6cb1-4ddf-be51-4f390a1a1189 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.569698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff28c6-706b-4ef2-914d-3dfac2e455ec None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.569880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ec81-6cb1-4ddf-be51-4f390a1a1189 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:14.570187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ec81-6cb1-4ddf-be51-4f390a1a1189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:14.570545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff28c6-706b-4ef2-914d-3dfac2e455ec None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.571022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff28c6-706b-4ef2-914d-3dfac2e455ec None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.571654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ec81-6cb1-4ddf-be51-4f390a1a1189 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:14.572156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff28c6-706b-4ef2-914d-3dfac2e455ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:14.572678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff28c6-706b-4ef2-914d-3dfac2e455ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:14.574481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff28c6-706b-4ef2-914d-3dfac2e455ec None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:14.588070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 394/796] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:14.589419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff28c6-706b-4ef2-914d-3dfac2e455ec None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.593150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 403/797] 10.222.0.74 () {56 vars in 1135 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:14.594799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ec81-6cb1-4ddf-be51-4f390a1a1189 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.702829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ec81-6cb1-4ddf-be51-4f390a1a1189 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.711171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff28c6-706b-4ef2-914d-3dfac2e455ec None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.728264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:14.741186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c5e0-1f76-46a6-ac13-0753e631fe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.741186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c5e0-1f76-46a6-ac13-0753e631fe3b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.741548 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c5e0-1f76-46a6-ac13-0753e631fe3b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.741808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c5e0-1f76-46a6-ac13-0753e631fe3b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.751041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9c5e0-1f76-46a6-ac13-0753e631fe3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:14.751342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9075ce7-674a-420b-a4a3-0bec539497a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.752286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9075ce7-674a-420b-a4a3-0bec539497a1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.752523 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9c5e0-1f76-46a6-ac13-0753e631fe3b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:14.753007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9075ce7-674a-420b-a4a3-0bec539497a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.753479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9075ce7-674a-420b-a4a3-0bec539497a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.754949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9075ce7-674a-420b-a4a3-0bec539497a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:14.755478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9075ce7-674a-420b-a4a3-0bec539497a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:14.758200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9075ce7-674a-420b-a4a3-0bec539497a1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:14.772376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 395/798] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-82e9c5e0-1f76-46a6-ac13-0753e631fe3b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:14.772895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:14.773822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:14.774828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:14.777240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9075ce7-674a-420b-a4a3-0bec539497a1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.778750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 404/799] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:14.779588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c5e0-1f76-46a6-ac13-0753e631fe3b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.790797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:14.896206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9075ce7-674a-420b-a4a3-0bec539497a1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.899735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c5e0-1f76-46a6-ac13-0753e631fe3b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:14.933118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88bf80-46ee-47f0-8df6-56d0eca9d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.933915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88bf80-46ee-47f0-8df6-56d0eca9d266 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.934195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88bf80-46ee-47f0-8df6-56d0eca9d266 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.934465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88bf80-46ee-47f0-8df6-56d0eca9d266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.935325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add1127-be6a-45fa-adc4-09c3b27a2f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:14.936108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add1127-be6a-45fa-adc4-09c3b27a2f42 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.936434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add1127-be6a-45fa-adc4-09c3b27a2f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.936717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add1127-be6a-45fa-adc4-09c3b27a2f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.946773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add1127-be6a-45fa-adc4-09c3b27a2f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:14.948093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88bf80-46ee-47f0-8df6-56d0eca9d266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:14.948226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add1127-be6a-45fa-adc4-09c3b27a2f42 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:14.950077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88bf80-46ee-47f0-8df6-56d0eca9d266 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-2add1127-be6a-45fa-adc4-09c3b27a2f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:14.967014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:14.968249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:14.969503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:14.969503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:14.969503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:14.969503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:14.969503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 405/800] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:14.969503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add1127-be6a-45fa-adc4-09c3b27a2f42 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-1d88bf80-46ee-47f0-8df6-56d0eca9d266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:14.973055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:14.974028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:14.974937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:14.974937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:14.974937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:14.974937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:14.979271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 396/801] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:14.981212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ba47-a35e-4944-9f13-05f4806ee29b None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:14.981509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ba47-a35e-4944-9f13-05f4806ee29b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:14.981791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ba47-a35e-4944-9f13-05f4806ee29b None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:14.987597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 397/802] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:14.987597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157ba47-a35e-4944-9f13-05f4806ee29b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.021408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.051520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.090632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add1127-be6a-45fa-adc4-09c3b27a2f42 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.101648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157ba47-a35e-4944-9f13-05f4806ee29b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.124600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717ebe-6c02-4faa-9a42-56123326c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.125272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717ebe-6c02-4faa-9a42-56123326c696 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.125551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717ebe-6c02-4faa-9a42-56123326c696 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.125823 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717ebe-6c02-4faa-9a42-56123326c696 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.126650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3717ebe-6c02-4faa-9a42-56123326c696 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:15.126962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3717ebe-6c02-4faa-9a42-56123326c696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.128410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3717ebe-6c02-4faa-9a42-56123326c696 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.141937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19af6be-e303-49f9-a19b-99968fcdc9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.142836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19af6be-e303-49f9-a19b-99968fcdc9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.143281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19af6be-e303-49f9-a19b-99968fcdc9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.143554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19af6be-e303-49f9-a19b-99968fcdc9e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.144282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19af6be-e303-49f9-a19b-99968fcdc9e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:15.144749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19af6be-e303-49f9-a19b-99968fcdc9e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.146158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19af6be-e303-49f9-a19b-99968fcdc9e2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.151714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 406/803] 10.222.0.74 () {56 vars in 1149 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:15.151714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717ebe-6c02-4faa-9a42-56123326c696 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.158913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 398/804] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:15.160725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f190b-b1e7-4c94-babf-ee844e7c3cb1 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.161021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f190b-b1e7-4c94-babf-ee844e7c3cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.161299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f190b-b1e7-4c94-babf-ee844e7c3cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.178085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-864f190b-b1e7-4c94-babf-ee844e7c3cb1 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:15.179272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-864f190b-b1e7-4c94-babf-ee844e7c3cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:15.245668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 399/805] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:15.246732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f190b-b1e7-4c94-babf-ee844e7c3cb1 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.248863 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.255799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717ebe-6c02-4faa-9a42-56123326c696 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.290962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5a19d-a27d-4faf-9d71-2adbd11383fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.291556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5a19d-a27d-4faf-9d71-2adbd11383fb None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.291843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5a19d-a27d-4faf-9d71-2adbd11383fb None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.292183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5a19d-a27d-4faf-9d71-2adbd11383fb None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.292945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5a19d-a27d-4faf-9d71-2adbd11383fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:15.293254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5a19d-a27d-4faf-9d71-2adbd11383fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.294638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5a19d-a27d-4faf-9d71-2adbd11383fb None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.298128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.310458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 407/806] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:15.311324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5a19d-a27d-4faf-9d71-2adbd11383fb None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.347606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f190b-b1e7-4c94-babf-ee844e7c3cb1 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.381549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd74645-2b60-4a7e-9729-035dc164bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.382342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd74645-2b60-4a7e-9729-035dc164bc90 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.382629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd74645-2b60-4a7e-9729-035dc164bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.382901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd74645-2b60-4a7e-9729-035dc164bc90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.393223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd74645-2b60-4a7e-9729-035dc164bc90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.395360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd74645-2b60-4a7e-9729-035dc164bc90 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.410283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5a19d-a27d-4faf-9d71-2adbd11383fb None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-cbd74645-2b60-4a7e-9729-035dc164bc90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:15.412573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:15.413615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:15.414728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:15.414728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:15.414728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:15.414728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:15.414728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 400/807] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:15.415073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cd70e-8c3e-411d-a02f-5b88d88bd5f2 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.415259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cd70e-8c3e-411d-a02f-5b88d88bd5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.415539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cd70e-8c3e-411d-a02f-5b88d88bd5f2 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.420422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 401/808] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:15.420422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cd70e-8c3e-411d-a02f-5b88d88bd5f2 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.446644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3bb17-254f-438a-970b-e4f6b19b311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.447435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3bb17-254f-438a-970b-e4f6b19b311e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.447715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3bb17-254f-438a-970b-e4f6b19b311e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.447992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3bb17-254f-438a-970b-e4f6b19b311e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.455422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3bb17-254f-438a-970b-e4f6b19b311e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.457053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3bb17-254f-438a-970b-e4f6b19b311e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-70d3bb17-254f-438a-970b-e4f6b19b311e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:15.470798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:15.471756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 408/809] 10.222.0.74 () {56 vars in 1093 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:15.473780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3bb17-254f-438a-970b-e4f6b19b311e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.490293 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.527302 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cd70e-8c3e-411d-a02f-5b88d88bd5f2 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.528834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.561805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8ece2-066d-40c7-bccc-0b0c6fe883d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.562544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8ece2-066d-40c7-bccc-0b0c6fe883d6 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.562833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8ece2-066d-40c7-bccc-0b0c6fe883d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.563107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8ece2-066d-40c7-bccc-0b0c6fe883d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.563764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8ece2-066d-40c7-bccc-0b0c6fe883d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.565194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8ece2-066d-40c7-bccc-0b0c6fe883d6 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.573476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3bb17-254f-438a-970b-e4f6b19b311e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-53e8ece2-066d-40c7-bccc-0b0c6fe883d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:15.578378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:15.579294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 16:27:15.580137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:15.581495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 402/810] 10.222.0.74 () {56 vars in 1129 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:15.581495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8ece2-066d-40c7-bccc-0b0c6fe883d6 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.609446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b681625-7f9b-4070-b6e2-d5039f62f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.610233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b681625-7f9b-4070-b6e2-d5039f62f294 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.610514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b681625-7f9b-4070-b6e2-d5039f62f294 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.610790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b681625-7f9b-4070-b6e2-d5039f62f294 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.618367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b681625-7f9b-4070-b6e2-d5039f62f294 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.619803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b681625-7f9b-4070-b6e2-d5039f62f294 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-0b681625-7f9b-4070-b6e2-d5039f62f294 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:15.633691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:15.634702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:15.635600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:15.635600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:15.635600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:15.635600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:15.635600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:15.635600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:15.635600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:15.635600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:15.635600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 409/811] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:15.636090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aa42a-863a-4eb0-875e-ce2145b13fe4 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.636600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aa42a-863a-4eb0-875e-ce2145b13fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.636600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aa42a-863a-4eb0-875e-ce2145b13fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.653400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7c2aa42a-863a-4eb0-875e-ce2145b13fe4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:15.654565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7c2aa42a-863a-4eb0-875e-ce2145b13fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:15.686139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8ece2-066d-40c7-bccc-0b0c6fe883d6 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.718910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92fdce-5d22-4dab-8140-569826bd3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.719393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 410/812] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:15.719601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92fdce-5d22-4dab-8140-569826bd3910 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.719849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92fdce-5d22-4dab-8140-569826bd3910 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.720045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aa42a-863a-4eb0-875e-ce2145b13fe4 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.720213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92fdce-5d22-4dab-8140-569826bd3910 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.720928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92fdce-5d22-4dab-8140-569826bd3910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:15.721242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92fdce-5d22-4dab-8140-569826bd3910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.722748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92fdce-5d22-4dab-8140-569826bd3910 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.724030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.744082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 403/813] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:15.744082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92fdce-5d22-4dab-8140-569826bd3910 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.768578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.825910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aa42a-863a-4eb0-875e-ce2145b13fe4 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.839841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92fdce-5d22-4dab-8140-569826bd3910 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.859678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4de71-49c2-46d3-a635-75541f7c9213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.860385 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4de71-49c2-46d3-a635-75541f7c9213 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.860670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4de71-49c2-46d3-a635-75541f7c9213 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.860945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4de71-49c2-46d3-a635-75541f7c9213 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.861777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4de71-49c2-46d3-a635-75541f7c9213 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:15.862086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4de71-49c2-46d3-a635-75541f7c9213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.864055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4de71-49c2-46d3-a635-75541f7c9213 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.874476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c6ed5-3b8d-4a34-9c46-0cb728c00a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:15.875129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c6ed5-3b8d-4a34-9c46-0cb728c00a9f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:15.875413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c6ed5-3b8d-4a34-9c46-0cb728c00a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:15.875688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c6ed5-3b8d-4a34-9c46-0cb728c00a9f None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:15.876422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c6ed5-3b8d-4a34-9c46-0cb728c00a9f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:15.876730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c6ed5-3b8d-4a34-9c46-0cb728c00a9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:15.878113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c6ed5-3b8d-4a34-9c46-0cb728c00a9f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:15.881448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 411/814] 10.222.0.74 () {56 vars in 1133 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:15.882245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4de71-49c2-46d3-a635-75541f7c9213 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.888185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 404/815] 10.222.0.74 () {56 vars in 1124 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:15.888185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c6ed5-3b8d-4a34-9c46-0cb728c00a9f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:15.944712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.976114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:15.983347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4de71-49c2-46d3-a635-75541f7c9213 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:15.985876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c6ed5-3b8d-4a34-9c46-0cb728c00a9f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.017224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf4d41-2602-40b3-b201-56274b576ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.017872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf4d41-2602-40b3-b201-56274b576ded None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.018149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf4d41-2602-40b3-b201-56274b576ded None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.018419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf4d41-2602-40b3-b201-56274b576ded None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.019190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf4d41-2602-40b3-b201-56274b576ded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:16.019594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf4d41-2602-40b3-b201-56274b576ded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.020782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424d22d-28c4-480a-89e6-855590791131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.021088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf4d41-2602-40b3-b201-56274b576ded None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.021577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424d22d-28c4-480a-89e6-855590791131 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.021863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424d22d-28c4-480a-89e6-855590791131 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.022140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424d22d-28c4-480a-89e6-855590791131 None admin] PATH_INFO: `/v3/services/network` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.022790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424d22d-28c4-480a-89e6-855590791131 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.024150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424d22d-28c4-480a-89e6-855590791131 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.032133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 412/816] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:16.032931 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf4d41-2602-40b3-b201-56274b576ded None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-4424d22d-28c4-480a-89e6-855590791131 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:16.036765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:16.037775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 16:27:16.038680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:16.042701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 405/817] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:15 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:16.043542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424d22d-28c4-480a-89e6-855590791131 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.136938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf4d41-2602-40b3-b201-56274b576ded None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.147435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424d22d-28c4-480a-89e6-855590791131 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.159339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:16.171135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dcce9-159c-4bc3-b46f-dcdd09250f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.172422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dcce9-159c-4bc3-b46f-dcdd09250f17 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.172422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dcce9-159c-4bc3-b46f-dcdd09250f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.172631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dcce9-159c-4bc3-b46f-dcdd09250f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.179010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03dcce9-159c-4bc3-b46f-dcdd09250f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.180483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03dcce9-159c-4bc3-b46f-dcdd09250f17 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.181106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e240a63-bf1e-4c7b-babf-ae874cc325c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.181819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e240a63-bf1e-4c7b-babf-ae874cc325c5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.182110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e240a63-bf1e-4c7b-babf-ae874cc325c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.182390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e240a63-bf1e-4c7b-babf-ae874cc325c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-f03dcce9-159c-4bc3-b46f-dcdd09250f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:16.195138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:16.196056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:16.196988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:16.196988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:16.196988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:16.196988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:16.196988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:16.196988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:16.196988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:16.196988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:16.201594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 413/818] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:16.202557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dcce9-159c-4bc3-b46f-dcdd09250f17 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.206980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:16.251311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e240a63-bf1e-4c7b-babf-ae874cc325c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.253029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e240a63-bf1e-4c7b-babf-ae874cc325c5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.303027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dcce9-159c-4bc3-b46f-dcdd09250f17 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.336481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68386b2-185f-4f36-acb3-271b2f39f3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.337140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68386b2-185f-4f36-acb3-271b2f39f3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.337418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68386b2-185f-4f36-acb3-271b2f39f3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.337692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68386b2-185f-4f36-acb3-271b2f39f3f2 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.338388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68386b2-185f-4f36-acb3-271b2f39f3f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:16.338691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68386b2-185f-4f36-acb3-271b2f39f3f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.340051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68386b2-185f-4f36-acb3-271b2f39f3f2 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.345079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 414/819] 10.222.0.74 () {56 vars in 1124 bytes} [Mon May 23 16:27:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:16.345985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68386b2-185f-4f36-acb3-271b2f39f3f2 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.354740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 406/820] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:27:16.355647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e240a63-bf1e-4c7b-babf-ae874cc325c5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.392429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:16.411326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:16.444939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68386b2-185f-4f36-acb3-271b2f39f3f2 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.455892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e240a63-bf1e-4c7b-babf-ae874cc325c5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.479152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b177f6d-5aee-47ec-bf66-32dbe8868771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.480039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b177f6d-5aee-47ec-bf66-32dbe8868771 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.480341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b177f6d-5aee-47ec-bf66-32dbe8868771 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.480619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b177f6d-5aee-47ec-bf66-32dbe8868771 None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/45f676694ec24de2a5c755e217baed87/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.482570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b177f6d-5aee-47ec-bf66-32dbe8868771 None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=45f676694ec24de2a5c755e217baed87, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.484008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b177f6d-5aee-47ec-bf66-32dbe8868771 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.490189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece3aa6-81e5-4d86-b443-61342e73edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.490856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece3aa6-81e5-4d86-b443-61342e73edb1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.491141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece3aa6-81e5-4d86-b443-61342e73edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.491421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece3aa6-81e5-4d86-b443-61342e73edb1 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.492124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece3aa6-81e5-4d86-b443-61342e73edb1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:16.492573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece3aa6-81e5-4d86-b443-61342e73edb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.493935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece3aa6-81e5-4d86-b443-61342e73edb1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.498481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 407/821] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:16.499253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece3aa6-81e5-4d86-b443-61342e73edb1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.541208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 415/822] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:27:16 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/45f676694ec24de2a5c755e217baed87/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:16.541965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b177f6d-5aee-47ec-bf66-32dbe8868771 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.611205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece3aa6-81e5-4d86-b443-61342e73edb1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.634511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:16.650641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef69753-6ec9-46ec-b2b4-e969430a23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.651308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef69753-6ec9-46ec-b2b4-e969430a23bd None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.651944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef69753-6ec9-46ec-b2b4-e969430a23bd None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.652232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef69753-6ec9-46ec-b2b4-e969430a23bd None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.653374 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef69753-6ec9-46ec-b2b4-e969430a23bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:16.653690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef69753-6ec9-46ec-b2b4-e969430a23bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.655976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef69753-6ec9-46ec-b2b4-e969430a23bd None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.657718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b177f6d-5aee-47ec-bf66-32dbe8868771 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.665992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:16.671462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 408/823] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:16.672370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef69753-6ec9-46ec-b2b4-e969430a23bd None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.700203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c00c8-b508-4c22-84af-b8bbb51a019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.700932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c00c8-b508-4c22-84af-b8bbb51a019e None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.701219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c00c8-b508-4c22-84af-b8bbb51a019e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.701492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c00c8-b508-4c22-84af-b8bbb51a019e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.702246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c00c8-b508-4c22-84af-b8bbb51a019e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.703646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c00c8-b508-4c22-84af-b8bbb51a019e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.783984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef69753-6ec9-46ec-b2b4-e969430a23bd None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.798777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 416/824] 10.222.0.74 () {60 vars in 1144 bytes} [Mon May 23 16:27:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:16.799624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c00c8-b508-4c22-84af-b8bbb51a019e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.840711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8f47e-34ed-4ebe-8094-9ae1706ebf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.841923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8f47e-34ed-4ebe-8094-9ae1706ebf94 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.842384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8f47e-34ed-4ebe-8094-9ae1706ebf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.842868 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8f47e-34ed-4ebe-8094-9ae1706ebf94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.857088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8f47e-34ed-4ebe-8094-9ae1706ebf94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.859084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8f47e-34ed-4ebe-8094-9ae1706ebf94 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-19e8f47e-34ed-4ebe-8094-9ae1706ebf94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:16.885100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:16.886082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:16.886974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:16.886974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:16.886974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:16.886974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:16.890190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 409/825] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:16.891552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8f47e-34ed-4ebe-8094-9ae1706ebf94 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:16.924059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c00c8-b508-4c22-84af-b8bbb51a019e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:16.929976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:16.973658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fc091-5ca4-425e-876a-b562ddcd813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:16.974782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc091-5ca4-425e-876a-b562ddcd813a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:16.975220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc091-5ca4-425e-876a-b562ddcd813a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:16.975646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc091-5ca4-425e-876a-b562ddcd813a None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:16.976794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fc091-5ca4-425e-876a-b562ddcd813a None admin] RBAC: Adding query filter params (type=network) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:16.977812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fc091-5ca4-425e-876a-b562ddcd813a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:16.979756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fc091-5ca4-425e-876a-b562ddcd813a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:16.991549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 417/826] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:16.991549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fc091-5ca4-425e-876a-b562ddcd813a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:17.025819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8f47e-34ed-4ebe-8094-9ae1706ebf94 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:17.029698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:17.071570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333798e-f63f-4b7a-9673-d6b481854494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:17.073271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333798e-f63f-4b7a-9673-d6b481854494 None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:17.073978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333798e-f63f-4b7a-9673-d6b481854494 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:17.074435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333798e-f63f-4b7a-9673-d6b481854494 None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/d673b38649fe44059ae0257df02ed61f/roles/e521dfb490db4640aa9c1390bf4e209e` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:17.094127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333798e-f63f-4b7a-9673-d6b481854494 None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=d673b38649fe44059ae0257df02ed61f, role_id=e521dfb490db4640aa9c1390bf4e209e)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:17.096583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333798e-f63f-4b7a-9673-d6b481854494 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:17.120265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fc091-5ca4-425e-876a-b562ddcd813a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:17.156559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2243d8-f609-4392-83f4-691242d2425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:17.157228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2243d8-f609-4392-83f4-691242d2425b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:17.157510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2243d8-f609-4392-83f4-691242d2425b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:17.157785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2243d8-f609-4392-83f4-691242d2425b None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:17.158510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2243d8-f609-4392-83f4-691242d2425b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:17.158816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2243d8-f609-4392-83f4-691242d2425b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:17.160250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2243d8-f609-4392-83f4-691242d2425b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:17.165729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 410/827] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:27:16 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/d673b38649fe44059ae0257df02ed61f/roles/e521dfb490db4640aa9c1390bf4e209e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:17.169424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333798e-f63f-4b7a-9673-d6b481854494 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:17.185349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 418/828] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:17.191333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2243d8-f609-4392-83f4-691242d2425b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:17.265929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:17.293563 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333798e-f63f-4b7a-9673-d6b481854494 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:17.335958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec717e90-80a0-47cf-af0b-75d392c42233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:17.336820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec717e90-80a0-47cf-af0b-75d392c42233 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:17.337206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec717e90-80a0-47cf-af0b-75d392c42233 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:17.337584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec717e90-80a0-47cf-af0b-75d392c42233 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:17.338468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec717e90-80a0-47cf-af0b-75d392c42233 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:17.339945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec717e90-80a0-47cf-af0b-75d392c42233 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:17.403725 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:17.421141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2243d8-f609-4392-83f4-691242d2425b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:17.448647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 411/829] 10.222.0.74 () {60 vars in 1144 bytes} [Mon May 23 16:27:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:17.479356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a7acc-32c4-4901-8005-374fe9d49968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:17.480612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a7acc-32c4-4901-8005-374fe9d49968 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:17.481100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a7acc-32c4-4901-8005-374fe9d49968 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:17.481577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a7acc-32c4-4901-8005-374fe9d49968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:17.492564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a7acc-32c4-4901-8005-374fe9d49968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:17.494277 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a7acc-32c4-4901-8005-374fe9d49968 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-841a7acc-32c4-4901-8005-374fe9d49968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:17.513952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:17.514974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:17.516134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:17.516134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:17.516134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:17.516134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:17.516134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:17.516134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:17.516134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:17.516134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:17.520667 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 419/830] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:17.522125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec717e90-80a0-47cf-af0b-75d392c42233 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:17.677452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec717e90-80a0-47cf-af0b-75d392c42233 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:17.725851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:17.737195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0f209-07b6-4d4c-8120-e45fb9dcbb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:17.740631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0f209-07b6-4d4c-8120-e45fb9dcbb21 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:17.740631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0f209-07b6-4d4c-8120-e45fb9dcbb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:17.740631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0f209-07b6-4d4c-8120-e45fb9dcbb21 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:17.740631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0f209-07b6-4d4c-8120-e45fb9dcbb21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:17.740631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0f209-07b6-4d4c-8120-e45fb9dcbb21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:17.741797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0f209-07b6-4d4c-8120-e45fb9dcbb21 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:17.760057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 412/831] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:17.767969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a7acc-32c4-4901-8005-374fe9d49968 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:17.891473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a7acc-32c4-4901-8005-374fe9d49968 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:17.927121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21731340-2669-4543-b414-527dee3b7e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:17.927792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21731340-2669-4543-b414-527dee3b7e31 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:17.928076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21731340-2669-4543-b414-527dee3b7e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:17.928379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21731340-2669-4543-b414-527dee3b7e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:17.929213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21731340-2669-4543-b414-527dee3b7e31 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=951eca3289634609bcb684181e147ca3) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:17.929527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21731340-2669-4543-b414-527dee3b7e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:17.930955 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21731340-2669-4543-b414-527dee3b7e31 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:17.937341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 420/832] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:17 2022] GET /identity/v3/role_assignments?user.id=951eca3289634609bcb684181e147ca3&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:18.871101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043757c-bede-4e33-87fa-d21f844925a8 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:18.871662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043757c-bede-4e33-87fa-d21f844925a8 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:18.871662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043757c-bede-4e33-87fa-d21f844925a8 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:18.873274 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 413/833] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:18.878734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d600b6-9fa4-4bae-a4a2-e10a360717d8 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:18.879809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d600b6-9fa4-4bae-a4a2-e10a360717d8 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:18.879809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d600b6-9fa4-4bae-a4a2-e10a360717d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:18.891546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:18.896974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-25d600b6-9fa4-4bae-a4a2-e10a360717d8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:18.898149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-25d600b6-9fa4-4bae-a4a2-e10a360717d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:18.965244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 421/834] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:18.989761 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043757c-bede-4e33-87fa-d21f844925a8 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.097269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043757c-bede-4e33-87fa-d21f844925a8 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:19.133920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f40854-ad02-4a9f-b592-87403d841582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:19.134635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f40854-ad02-4a9f-b592-87403d841582 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.134920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f40854-ad02-4a9f-b592-87403d841582 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.135196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f40854-ad02-4a9f-b592-87403d841582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.146892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f40854-ad02-4a9f-b592-87403d841582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-30f40854-ad02-4a9f-b592-87403d841582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:19.154751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:19.155734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:19.156631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 414/835] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:19.162392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d600b6-9fa4-4bae-a4a2-e10a360717d8 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.199633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911def-3d45-4f2f-b974-ec7b14597a55 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.199933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911def-3d45-4f2f-b974-ec7b14597a55 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.200204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911def-3d45-4f2f-b974-ec7b14597a55 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.201997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 415/836] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:27:19.210270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3150-9806-4a77-bfb1-3c5559f0c76e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.210563 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3150-9806-4a77-bfb1-3c5559f0c76e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.210915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3150-9806-4a77-bfb1-3c5559f0c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.235188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-ef6f3150-9806-4a77-bfb1-3c5559f0c76e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:19.236818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ef6f3150-9806-4a77-bfb1-3c5559f0c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:19.280937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d600b6-9fa4-4bae-a4a2-e10a360717d8 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:19.312705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:19.318789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b04ddc-14c4-4475-a969-b87fcb572eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:19.319467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b04ddc-14c4-4475-a969-b87fcb572eca None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.319785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b04ddc-14c4-4475-a969-b87fcb572eca None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.320023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b04ddc-14c4-4475-a969-b87fcb572eca None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.321278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b04ddc-14c4-4475-a969-b87fcb572eca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:19.321596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b04ddc-14c4-4475-a969-b87fcb572eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:19.322982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b04ddc-14c4-4475-a969-b87fcb572eca None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:19.325335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:19.333132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 422/837] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:19.334672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 416/838] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:19.344373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b04ddc-14c4-4475-a969-b87fcb572eca None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.358719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f3150-9806-4a77-bfb1-3c5559f0c76e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.452788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b04ddc-14c4-4475-a969-b87fcb572eca None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:19.488662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd3593-3e85-4b64-8dda-877045137e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:19.489954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd3593-3e85-4b64-8dda-877045137e85 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.490615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd3593-3e85-4b64-8dda-877045137e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.491000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd3593-3e85-4b64-8dda-877045137e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.492623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f3150-9806-4a77-bfb1-3c5559f0c76e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:19.507406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd3593-3e85-4b64-8dda-877045137e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:19.509646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd3593-3e85-4b64-8dda-877045137e85 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-03fd3593-3e85-4b64-8dda-877045137e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:19.533011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:19.534055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:19.535517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:19.535517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:19.535517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:19.535517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:19.536457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 423/839] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:19.542322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd3593-3e85-4b64-8dda-877045137e85 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.548454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f877-ea0b-40c9-beb8-18eb0e589d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:19.549320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f877-ea0b-40c9-beb8-18eb0e589d07 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.549606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f877-ea0b-40c9-beb8-18eb0e589d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.549887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f877-ea0b-40c9-beb8-18eb0e589d07 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.551193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6f877-ea0b-40c9-beb8-18eb0e589d07 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:19.552747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6f877-ea0b-40c9-beb8-18eb0e589d07 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-03f6f877-ea0b-40c9-beb8-18eb0e589d07 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:19.569996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:19.571056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:27:19.572590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:19.576504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 417/840] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:27:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:19.577968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f877-ea0b-40c9-beb8-18eb0e589d07 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.615068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:19.640798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:19.672269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd3593-3e85-4b64-8dda-877045137e85 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:19.700673 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f877-ea0b-40c9-beb8-18eb0e589d07 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:19.712358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d7be4-ed67-4ab7-807c-cb10d66dd1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:19.713239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d7be4-ed67-4ab7-807c-cb10d66dd1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.713775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d7be4-ed67-4ab7-807c-cb10d66dd1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.714253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d7be4-ed67-4ab7-807c-cb10d66dd1d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.715156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d7be4-ed67-4ab7-807c-cb10d66dd1d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:19.715659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d7be4-ed67-4ab7-807c-cb10d66dd1d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:19.717651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d7be4-ed67-4ab7-807c-cb10d66dd1d2 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:19.730787 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 424/841] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:19.732385 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5674cb7-affd-4033-8cd2-753e4543be83 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.732866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5674cb7-affd-4033-8cd2-753e4543be83 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.733339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5674cb7-affd-4033-8cd2-753e4543be83 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.734714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 425/842] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:19.737424 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5674cb7-affd-4033-8cd2-753e4543be83 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.744383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c47855-0fa0-4eb0-90c6-834a710ba4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:19.745122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c47855-0fa0-4eb0-90c6-834a710ba4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.745410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c47855-0fa0-4eb0-90c6-834a710ba4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.745684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c47855-0fa0-4eb0-90c6-834a710ba4b0 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.746386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c47855-0fa0-4eb0-90c6-834a710ba4b0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:19.746687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c47855-0fa0-4eb0-90c6-834a710ba4b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:19.748513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c47855-0fa0-4eb0-90c6-834a710ba4b0 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:19.759135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 418/843] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:27:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:19.759135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131e821-62f0-4bc9-8e20-af5a6e35c21c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.759135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131e821-62f0-4bc9-8e20-af5a6e35c21c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.759135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131e821-62f0-4bc9-8e20-af5a6e35c21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.776382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c131e821-62f0-4bc9-8e20-af5a6e35c21c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:19.777577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c131e821-62f0-4bc9-8e20-af5a6e35c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:19.867910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 419/844] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:19.867910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131e821-62f0-4bc9-8e20-af5a6e35c21c None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.868165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5674cb7-affd-4033-8cd2-753e4543be83 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:19.875808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:19.902308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990438a-87d7-44dc-b27f-e0467398caf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:19.903563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990438a-87d7-44dc-b27f-e0467398caf3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.903851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990438a-87d7-44dc-b27f-e0467398caf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.904128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990438a-87d7-44dc-b27f-e0467398caf3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.905238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:19.913493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990438a-87d7-44dc-b27f-e0467398caf3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:19.921122 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990438a-87d7-44dc-b27f-e0467398caf3 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-f990438a-87d7-44dc-b27f-e0467398caf3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:19.930031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:19.931005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:19.931979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 426/845] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:19.932622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990438a-87d7-44dc-b27f-e0467398caf3 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.973837 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131e821-62f0-4bc9-8e20-af5a6e35c21c None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.010182 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317a7b-8c6e-49cc-8d59-264a3c692ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.010847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317a7b-8c6e-49cc-8d59-264a3c692ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.011133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317a7b-8c6e-49cc-8d59-264a3c692ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.011411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e317a7b-8c6e-49cc-8d59-264a3c692ff0 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.012140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317a7b-8c6e-49cc-8d59-264a3c692ff0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:20.012652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317a7b-8c6e-49cc-8d59-264a3c692ff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.014029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e317a7b-8c6e-49cc-8d59-264a3c692ff0 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.018831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 420/846] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:27:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:20.028617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317a7b-8c6e-49cc-8d59-264a3c692ff0 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.051145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990438a-87d7-44dc-b27f-e0467398caf3 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.091007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83247377-845a-47eb-a5e1-f391a6d6bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.091831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83247377-845a-47eb-a5e1-f391a6d6bb0a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.092115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83247377-845a-47eb-a5e1-f391a6d6bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.092422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83247377-845a-47eb-a5e1-f391a6d6bb0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.104698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83247377-845a-47eb-a5e1-f391a6d6bb0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-83247377-845a-47eb-a5e1-f391a6d6bb0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:20.113067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:20.114074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:20.114925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 427/847] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:27:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:20.121733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83247377-845a-47eb-a5e1-f391a6d6bb0a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.158827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:20.171206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e317a7b-8c6e-49cc-8d59-264a3c692ff0 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.174572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:20.227489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23c69b-4732-442f-ac70-dbd26a968912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.228537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c69b-4732-442f-ac70-dbd26a968912 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.228990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c69b-4732-442f-ac70-dbd26a968912 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.229419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c69b-4732-442f-ac70-dbd26a968912 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.230421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23c69b-4732-442f-ac70-dbd26a968912 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:20.230972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23c69b-4732-442f-ac70-dbd26a968912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.232787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23c69b-4732-442f-ac70-dbd26a968912 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.244644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83247377-845a-47eb-a5e1-f391a6d6bb0a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.257338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 421/848] 10.222.0.74 () {56 vars in 1135 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:20.263456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23c69b-4732-442f-ac70-dbd26a968912 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.295150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff8d0a-21e9-47ee-a281-64d6698ad23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.295829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff8d0a-21e9-47ee-a281-64d6698ad23a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.296272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff8d0a-21e9-47ee-a281-64d6698ad23a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.296484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff8d0a-21e9-47ee-a281-64d6698ad23a None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.297239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff8d0a-21e9-47ee-a281-64d6698ad23a None admin] RBAC: Adding query filter params (name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:20.297549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff8d0a-21e9-47ee-a281-64d6698ad23a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.298952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff8d0a-21e9-47ee-a281-64d6698ad23a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.318398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 428/849] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:20.323959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff8d0a-21e9-47ee-a281-64d6698ad23a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.377957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23c69b-4732-442f-ac70-dbd26a968912 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.423806 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b99da-4bf3-4bd5-a537-7905701af1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.424537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b99da-4bf3-4bd5-a537-7905701af1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.424827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b99da-4bf3-4bd5-a537-7905701af1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.425105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b99da-4bf3-4bd5-a537-7905701af1b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.435201 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:20.444319 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff8d0a-21e9-47ee-a281-64d6698ad23a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.457666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:20.481556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72984cfa-258b-4a07-9a04-2cac313b7cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.482303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72984cfa-258b-4a07-9a04-2cac313b7cbe None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.482565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72984cfa-258b-4a07-9a04-2cac313b7cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.482844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72984cfa-258b-4a07-9a04-2cac313b7cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.494373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72984cfa-258b-4a07-9a04-2cac313b7cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.495832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72984cfa-258b-4a07-9a04-2cac313b7cbe None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.497057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b99da-4bf3-4bd5-a537-7905701af1b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.498500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b99da-4bf3-4bd5-a537-7905701af1b2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-72984cfa-258b-4a07-9a04-2cac313b7cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:20.514033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:20.514942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:20.516098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:20.516098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:20.516098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:20.516098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:20.516098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 429/850] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:20.516977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc48f7-991b-4dc0-a792-2a509bee067b None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.517134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc48f7-991b-4dc0-a792-2a509bee067b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.517397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc48f7-991b-4dc0-a792-2a509bee067b None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.518808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 430/851] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:20.522132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc48f7-991b-4dc0-a792-2a509bee067b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.612013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 422/852] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:27:20.614719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c273754-13f2-451c-b270-85637821cbcf None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.614719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c273754-13f2-451c-b270-85637821cbcf None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.614974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c273754-13f2-451c-b270-85637821cbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.632406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6c273754-13f2-451c-b270-85637821cbcf None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:20.633585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6c273754-13f2-451c-b270-85637821cbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:20.633790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc48f7-991b-4dc0-a792-2a509bee067b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.670729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda7f5-c169-44a9-906b-031f730f9438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.671394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda7f5-c169-44a9-906b-031f730f9438 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.671670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda7f5-c169-44a9-906b-031f730f9438 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.671940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda7f5-c169-44a9-906b-031f730f9438 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.672693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda7f5-c169-44a9-906b-031f730f9438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:20.672996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda7f5-c169-44a9-906b-031f730f9438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.674355 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda7f5-c169-44a9-906b-031f730f9438 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.688224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 431/853] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:20.689071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda7f5-c169-44a9-906b-031f730f9438 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.694945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:20.701569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:20.713322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 423/854] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:20.714367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c273754-13f2-451c-b270-85637821cbcf None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.818287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda7f5-c169-44a9-906b-031f730f9438 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.821738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c273754-13f2-451c-b270-85637821cbcf None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.856748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999114d-b978-4a0e-8e77-e48424bdd293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.857553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999114d-b978-4a0e-8e77-e48424bdd293 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.857841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999114d-b978-4a0e-8e77-e48424bdd293 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.858210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999114d-b978-4a0e-8e77-e48424bdd293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.858563 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442030-cd0c-469d-9037-1340cd144264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.859373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442030-cd0c-469d-9037-1340cd144264 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.859644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442030-cd0c-469d-9037-1340cd144264 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.859919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442030-cd0c-469d-9037-1340cd144264 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.867828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442030-cd0c-469d-9037-1340cd144264 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.869310 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442030-cd0c-469d-9037-1340cd144264 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.872712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999114d-b978-4a0e-8e77-e48424bdd293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.875254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999114d-b978-4a0e-8e77-e48424bdd293 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-b1442030-cd0c-469d-9037-1340cd144264 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:20.884821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:20.885814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:20.886776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 424/855] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:20.887373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442030-cd0c-469d-9037-1340cd144264 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-9999114d-b978-4a0e-8e77-e48424bdd293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:20.898268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:20.899245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:20.905494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:20.905494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:20.905494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:20.905494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:20.905494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 432/856] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:20.905494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999114d-b978-4a0e-8e77-e48424bdd293 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.947263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:20.967408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:20.996655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442030-cd0c-469d-9037-1340cd144264 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.018611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999114d-b978-4a0e-8e77-e48424bdd293 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.034308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71312ac-d9cb-4c49-aaa5-9f3ff041ef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.035982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71312ac-d9cb-4c49-aaa5-9f3ff041ef07 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.036267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71312ac-d9cb-4c49-aaa5-9f3ff041ef07 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.036768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71312ac-d9cb-4c49-aaa5-9f3ff041ef07 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.037407 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71312ac-d9cb-4c49-aaa5-9f3ff041ef07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.038785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71312ac-d9cb-4c49-aaa5-9f3ff041ef07 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-e71312ac-d9cb-4c49-aaa5-9f3ff041ef07 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:21.051719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:21.057936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:21.058844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 425/857] 10.222.0.74 () {56 vars in 1132 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:21.059691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71312ac-d9cb-4c49-aaa5-9f3ff041ef07 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.059793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea58f7-7a5b-4af2-a542-68995dd3509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.059793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea58f7-7a5b-4af2-a542-68995dd3509f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.059793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea58f7-7a5b-4af2-a542-68995dd3509f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.059793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea58f7-7a5b-4af2-a542-68995dd3509f None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.060481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea58f7-7a5b-4af2-a542-68995dd3509f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:21.060773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea58f7-7a5b-4af2-a542-68995dd3509f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.062185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea58f7-7a5b-4af2-a542-68995dd3509f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.086163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 433/858] 10.222.0.74 () {56 vars in 1149 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:21.086163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea58f7-7a5b-4af2-a542-68995dd3509f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.170834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71312ac-d9cb-4c49-aaa5-9f3ff041ef07 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.188137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea58f7-7a5b-4af2-a542-68995dd3509f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.188633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:21.206439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:21.210340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98b448-ebaf-4417-a665-2c0d3f3dd013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.214753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98b448-ebaf-4417-a665-2c0d3f3dd013 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.214753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98b448-ebaf-4417-a665-2c0d3f3dd013 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.214753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98b448-ebaf-4417-a665-2c0d3f3dd013 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.214753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98b448-ebaf-4417-a665-2c0d3f3dd013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:21.214753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98b448-ebaf-4417-a665-2c0d3f3dd013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.214753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98b448-ebaf-4417-a665-2c0d3f3dd013 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.227870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 426/859] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:21.228913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98b448-ebaf-4417-a665-2c0d3f3dd013 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.235033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7ea1c-0349-49c2-9523-da90a362438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.235811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7ea1c-0349-49c2-9523-da90a362438c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.236095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7ea1c-0349-49c2-9523-da90a362438c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.236400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7ea1c-0349-49c2-9523-da90a362438c None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.237116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7ea1c-0349-49c2-9523-da90a362438c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:21.237484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7ea1c-0349-49c2-9523-da90a362438c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.239553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7ea1c-0349-49c2-9523-da90a362438c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.244421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 434/860] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:21.245260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7ea1c-0349-49c2-9523-da90a362438c None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.351840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7ea1c-0349-49c2-9523-da90a362438c None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.355291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98b448-ebaf-4417-a665-2c0d3f3dd013 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.392658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9adf7-d359-4593-ba86-3fbca76fb12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.393308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9adf7-d359-4593-ba86-3fbca76fb12a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.393602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9adf7-d359-4593-ba86-3fbca76fb12a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.393702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e080-f05f-4053-a073-f546124a9d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.393899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9adf7-d359-4593-ba86-3fbca76fb12a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.394591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e080-f05f-4053-a073-f546124a9d33 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.394880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e080-f05f-4053-a073-f546124a9d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.395156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e080-f05f-4053-a073-f546124a9d33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.402111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4e080-f05f-4053-a073-f546124a9d33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.403551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4e080-f05f-4053-a073-f546124a9d33 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-f8a4e080-f05f-4053-a073-f546124a9d33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:21.418446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:21.419338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:21.420232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:21.420232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:21.420232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:21.420232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:21.420232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:21.420232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:21.420232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:21.420232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:21.420232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 435/861] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:21.421267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e080-f05f-4053-a073-f546124a9d33 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.449663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:21.464004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:21.473740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9adf7-d359-4593-ba86-3fbca76fb12a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.475209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9adf7-d359-4593-ba86-3fbca76fb12a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.524058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e080-f05f-4053-a073-f546124a9d33 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.560566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467c3c-f83d-409c-8320-ce1bafad22af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.561230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467c3c-f83d-409c-8320-ce1bafad22af None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.561509 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467c3c-f83d-409c-8320-ce1bafad22af None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.561780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467c3c-f83d-409c-8320-ce1bafad22af None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.562595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1467c3c-f83d-409c-8320-ce1bafad22af None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:21.562902 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1467c3c-f83d-409c-8320-ce1bafad22af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.564260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1467c3c-f83d-409c-8320-ce1bafad22af None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.576330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 436/862] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:21.576330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467c3c-f83d-409c-8320-ce1bafad22af None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.587221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 427/863] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:27:21.593807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9adf7-d359-4593-ba86-3fbca76fb12a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.705979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467c3c-f83d-409c-8320-ce1bafad22af None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.705979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:21.709230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:21.736072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9adf7-d359-4593-ba86-3fbca76fb12a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.742795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea8df8-e26b-468a-acf7-7f658762a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.743483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea8df8-e26b-468a-acf7-7f658762a941 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.743769 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea8df8-e26b-468a-acf7-7f658762a941 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.744048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea8df8-e26b-468a-acf7-7f658762a941 None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.745009 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea8df8-e26b-468a-acf7-7f658762a941 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:21.745387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea8df8-e26b-468a-acf7-7f658762a941 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.747449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea8df8-e26b-468a-acf7-7f658762a941 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.766681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 437/864] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:21.768580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea8df8-e26b-468a-acf7-7f658762a941 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.779740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65842e66-debd-4f56-9905-747d109ba73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.780859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65842e66-debd-4f56-9905-747d109ba73f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.781139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65842e66-debd-4f56-9905-747d109ba73f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.785683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65842e66-debd-4f56-9905-747d109ba73f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.794856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65842e66-debd-4f56-9905-747d109ba73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.796503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65842e66-debd-4f56-9905-747d109ba73f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-65842e66-debd-4f56-9905-747d109ba73f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:21.819271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:21.820214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:21.821191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:21.821191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:21.821191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:21.821191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:21.821191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 428/865] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:21.827878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65842e66-debd-4f56-9905-747d109ba73f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.901882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea8df8-e26b-468a-acf7-7f658762a941 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.945400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65842e66-debd-4f56-9905-747d109ba73f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.953103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1111-5731-4b2f-b708-461d5bd9104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.954316 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1111-5731-4b2f-b708-461d5bd9104b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.954605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1111-5731-4b2f-b708-461d5bd9104b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.954881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1111-5731-4b2f-b708-461d5bd9104b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.956248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1111-5731-4b2f-b708-461d5bd9104b None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=45f676694ec24de2a5c755e217baed87) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:21.956563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1111-5731-4b2f-b708-461d5bd9104b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.959666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1111-5731-4b2f-b708-461d5bd9104b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.968583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 438/866] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/role_assignments?user.id=45f676694ec24de2a5c755e217baed87&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:21.984710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:21.995056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0bb94-d037-4f26-85d8-0efb1169dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.995820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0bb94-d037-4f26-85d8-0efb1169dee5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.996113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0bb94-d037-4f26-85d8-0efb1169dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.997464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0bb94-d037-4f26-85d8-0efb1169dee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.997464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0bb94-d037-4f26-85d8-0efb1169dee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:21.997641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0bb94-d037-4f26-85d8-0efb1169dee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.999071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0bb94-d037-4f26-85d8-0efb1169dee5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.013363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 429/867] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:22.018974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1111-5731-4b2f-b708-461d5bd9104b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.053350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:22.146173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1111-5731-4b2f-b708-461d5bd9104b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.194194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08387b-3e7f-4d4c-bfcf-e5b9f1db1828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.194194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08387b-3e7f-4d4c-bfcf-e5b9f1db1828 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.194194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08387b-3e7f-4d4c-bfcf-e5b9f1db1828 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.194194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08387b-3e7f-4d4c-bfcf-e5b9f1db1828 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.202117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08387b-3e7f-4d4c-bfcf-e5b9f1db1828 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.202117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08387b-3e7f-4d4c-bfcf-e5b9f1db1828 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-1b08387b-3e7f-4d4c-bfcf-e5b9f1db1828 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:22.217896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:22.218734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:22.219635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:22.219635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:22.219635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:22.219635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:22.219635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:22.219635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:22.219635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:22.219635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:22.219635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 439/868] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:22.226645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0bb94-d037-4f26-85d8-0efb1169dee5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.335685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0bb94-d037-4f26-85d8-0efb1169dee5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.343518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd774-1a01-46c8-a9c3-13300cf7976c None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.343801 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd774-1a01-46c8-a9c3-13300cf7976c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.344085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd774-1a01-46c8-a9c3-13300cf7976c None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.346263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 440/869] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:22.353393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1179-646e-4d42-b6e2-baf8640e2920 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.353975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1179-646e-4d42-b6e2-baf8640e2920 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.354768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1179-646e-4d42-b6e2-baf8640e2920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.372990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c79b1179-646e-4d42-b6e2-baf8640e2920 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:22.374519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c79b1179-646e-4d42-b6e2-baf8640e2920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:22.384433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845478b-8395-42d2-a6f0-b619101bbd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.385152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845478b-8395-42d2-a6f0-b619101bbd24 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.385436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845478b-8395-42d2-a6f0-b619101bbd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.385705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845478b-8395-42d2-a6f0-b619101bbd24 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.386494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845478b-8395-42d2-a6f0-b619101bbd24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:22.388930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845478b-8395-42d2-a6f0-b619101bbd24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.390668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845478b-8395-42d2-a6f0-b619101bbd24 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.405304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 430/870] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:22.412329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845478b-8395-42d2-a6f0-b619101bbd24 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.462813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 441/871] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:22.471286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:22.491495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1179-646e-4d42-b6e2-baf8640e2920 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.510376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:22.532923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845478b-8395-42d2-a6f0-b619101bbd24 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.579219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dced8-babd-4231-8501-bfa68112c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.579904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dced8-babd-4231-8501-bfa68112c59b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.580174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dced8-babd-4231-8501-bfa68112c59b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.580481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dced8-babd-4231-8501-bfa68112c59b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.581438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dced8-babd-4231-8501-bfa68112c59b None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=d673b38649fe44059ae0257df02ed61f) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:22.581842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dced8-babd-4231-8501-bfa68112c59b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.583598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dced8-babd-4231-8501-bfa68112c59b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.590593 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 431/872] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:22 2022] GET /identity/v3/role_assignments?user.id=d673b38649fe44059ae0257df02ed61f&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:22.606248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1179-646e-4d42-b6e2-baf8640e2920 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.647422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5d757-a315-436b-aeb5-086b8110e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.648408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5d757-a315-436b-aeb5-086b8110e5a5 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.648947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5d757-a315-436b-aeb5-086b8110e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.649371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5d757-a315-436b-aeb5-086b8110e5a5 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.650279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5d757-a315-436b-aeb5-086b8110e5a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.651867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5d757-a315-436b-aeb5-086b8110e5a5 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.732638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 442/873] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:27:22 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:27:23.965711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35001a04-3091-49a8-ab81-3c5a9606ed18 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:23.966343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35001a04-3091-49a8-ab81-3c5a9606ed18 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:23.966343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35001a04-3091-49a8-ab81-3c5a9606ed18 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:23.968035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 432/874] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:23.973999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ab1a-c74f-464d-8221-70e513b07f1e None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:23.974488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ab1a-c74f-464d-8221-70e513b07f1e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:23.974573 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ab1a-c74f-464d-8221-70e513b07f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:23.992142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2b84ab1a-c74f-464d-8221-70e513b07f1e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:23.993366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2b84ab1a-c74f-464d-8221-70e513b07f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:24.071002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 443/875] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:24.093399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35001a04-3091-49a8-ab81-3c5a9606ed18 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:24.202344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35001a04-3091-49a8-ab81-3c5a9606ed18 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:24.232682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:24.238608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c9ba2-f7e8-4db3-8592-13f579209164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:24.242795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c9ba2-f7e8-4db3-8592-13f579209164 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:24.242795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c9ba2-f7e8-4db3-8592-13f579209164 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:24.242795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c9ba2-f7e8-4db3-8592-13f579209164 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:24.242795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c9ba2-f7e8-4db3-8592-13f579209164 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:24.242795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c9ba2-f7e8-4db3-8592-13f579209164 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:24.344220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 433/876] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:27:24 2022] POST /identity/v3/services => generated 269 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:24.381935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ff31-d901-402e-8380-a61c68760961 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:24.382281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ff31-d901-402e-8380-a61c68760961 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:24.382491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ff31-d901-402e-8380-a61c68760961 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:24.384204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 444/877] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:24.390026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f541c-b49e-4d50-b22e-78bed03488fe None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:24.390603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f541c-b49e-4d50-b22e-78bed03488fe None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:24.390846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f541c-b49e-4d50-b22e-78bed03488fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:24.410083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5b1f541c-b49e-4d50-b22e-78bed03488fe None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:24.411318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5b1f541c-b49e-4d50-b22e-78bed03488fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:24.501495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 434/878] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:24.524799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0ff31-d901-402e-8380-a61c68760961 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:24.527817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:24.637964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0ff31-d901-402e-8380-a61c68760961 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:24.673644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2a15-f4ed-44f3-baca-4f7d42d4bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:24.674452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2a15-f4ed-44f3-baca-4f7d42d4bf1e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:24.674733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2a15-f4ed-44f3-baca-4f7d42d4bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:24.675005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2a15-f4ed-44f3-baca-4f7d42d4bf1e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:24.676312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba2a15-f4ed-44f3-baca-4f7d42d4bf1e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:24.677994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba2a15-f4ed-44f3-baca-4f7d42d4bf1e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-66ba2a15-f4ed-44f3-baca-4f7d42d4bf1e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:24.690506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:24.693044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:24.695094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 445/879] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:24.700319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f541c-b49e-4d50-b22e-78bed03488fe None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:24.809249 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:24.813388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f541c-b49e-4d50-b22e-78bed03488fe None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:24.851670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd2f98-eecd-41ce-8841-0bd5069542e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:24.852409 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd2f98-eecd-41ce-8841-0bd5069542e5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:24.852694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd2f98-eecd-41ce-8841-0bd5069542e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:24.852975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd2f98-eecd-41ce-8841-0bd5069542e5 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:24.853715 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd2f98-eecd-41ce-8841-0bd5069542e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:24.854028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd2f98-eecd-41ce-8841-0bd5069542e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:24.855509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd2f98-eecd-41ce-8841-0bd5069542e5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:24.862502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 435/880] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:24.869913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2a15-f4ed-44f3-baca-4f7d42d4bf1e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:24.942172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:24.973814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f86fb-4557-45d3-a20a-0db52bf5d0e7 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:24.974357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f86fb-4557-45d3-a20a-0db52bf5d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:24.974591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f86fb-4557-45d3-a20a-0db52bf5d0e7 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:24.976172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 436/881] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:24.980152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2a15-f4ed-44f3-baca-4f7d42d4bf1e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:24.981267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6712-95d8-493d-81b0-8f53979eac45 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:24.981558 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6712-95d8-493d-81b0-8f53979eac45 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:24.981839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6712-95d8-493d-81b0-8f53979eac45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.001343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-320c6712-95d8-493d-81b0-8f53979eac45 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:25.002537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-320c6712-95d8-493d-81b0-8f53979eac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:25.026363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4dd94-bf6e-45a2-9669-5d3f858d9435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:25.027403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4dd94-bf6e-45a2-9669-5d3f858d9435 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.027906 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4dd94-bf6e-45a2-9669-5d3f858d9435 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.028430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4dd94-bf6e-45a2-9669-5d3f858d9435 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.029371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4dd94-bf6e-45a2-9669-5d3f858d9435 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:25.029890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4dd94-bf6e-45a2-9669-5d3f858d9435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:25.031467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4dd94-bf6e-45a2-9669-5d3f858d9435 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:25.037110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 446/882] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:25.055138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92c2ff-4fe4-49ee-861b-c998d5a0760f None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.055841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92c2ff-4fe4-49ee-861b-c998d5a0760f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.056379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92c2ff-4fe4-49ee-861b-c998d5a0760f None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.058442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 447/883] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:27:25.065171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31bfff-0d55-4586-868a-58d7268edebe None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.065363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31bfff-0d55-4586-868a-58d7268edebe None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.065630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31bfff-0d55-4586-868a-58d7268edebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.084165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-dd31bfff-0d55-4586-868a-58d7268edebe None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:25.085426 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-dd31bfff-0d55-4586-868a-58d7268edebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:25.097500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 437/884] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:25.124223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6712-95d8-493d-81b0-8f53979eac45 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:25.171145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 448/885] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:25.200348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31bfff-0d55-4586-868a-58d7268edebe None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:25.231212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:25.242328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6712-95d8-493d-81b0-8f53979eac45 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:25.284848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:25.286873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345046bd-4e29-4b20-b24d-24521042c1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:25.287701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345046bd-4e29-4b20-b24d-24521042c1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.287992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345046bd-4e29-4b20-b24d-24521042c1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.288268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345046bd-4e29-4b20-b24d-24521042c1d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.299615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345046bd-4e29-4b20-b24d-24521042c1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-345046bd-4e29-4b20-b24d-24521042c1d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:25.309709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:25.310886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:25.311918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 438/886] 10.222.0.74 () {56 vars in 1120 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:25.317719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345046bd-4e29-4b20-b24d-24521042c1d0 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:25.340569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31bfff-0d55-4586-868a-58d7268edebe None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:25.390836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8abf84-8f0e-40e8-a544-9be1a2b75b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:25.392118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8abf84-8f0e-40e8-a544-9be1a2b75b5b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.392744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8abf84-8f0e-40e8-a544-9be1a2b75b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.393223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8abf84-8f0e-40e8-a544-9be1a2b75b5b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.394626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8abf84-8f0e-40e8-a544-9be1a2b75b5b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:25.396514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8abf84-8f0e-40e8-a544-9be1a2b75b5b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-8f8abf84-8f0e-40e8-a544-9be1a2b75b5b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:25.411353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:25.412710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:27:25.413638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:25.417601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 449/887] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:25.423019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8abf84-8f0e-40e8-a544-9be1a2b75b5b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:25.453379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345046bd-4e29-4b20-b24d-24521042c1d0 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:25.491104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164ea78-9ee6-46eb-bc66-bd7068d6dfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:25.491578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164ea78-9ee6-46eb-bc66-bd7068d6dfca None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.491863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164ea78-9ee6-46eb-bc66-bd7068d6dfca None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.492137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164ea78-9ee6-46eb-bc66-bd7068d6dfca None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.492908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164ea78-9ee6-46eb-bc66-bd7068d6dfca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:25.493256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164ea78-9ee6-46eb-bc66-bd7068d6dfca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:25.494600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164ea78-9ee6-46eb-bc66-bd7068d6dfca None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:25.503110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 439/888] 10.222.0.74 () {56 vars in 1115 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:25.508408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164ea78-9ee6-46eb-bc66-bd7068d6dfca None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:25.526626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:25.541922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8abf84-8f0e-40e8-a544-9be1a2b75b5b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:25.568161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:25.579217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7269d-46bf-4f5b-837b-b92fc580b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:25.581942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7269d-46bf-4f5b-837b-b92fc580b3ff None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.581942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7269d-46bf-4f5b-837b-b92fc580b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.581942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7269d-46bf-4f5b-837b-b92fc580b3ff None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.581942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7269d-46bf-4f5b-837b-b92fc580b3ff None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:25.582446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7269d-46bf-4f5b-837b-b92fc580b3ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:25.583455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7269d-46bf-4f5b-837b-b92fc580b3ff None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:25.589016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 450/889] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:25.594307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7269d-46bf-4f5b-837b-b92fc580b3ff None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:25.642592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164ea78-9ee6-46eb-bc66-bd7068d6dfca None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:25.689369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26627d-9e57-4162-be75-54b1b687ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:25.690537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26627d-9e57-4162-be75-54b1b687ff6d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.692132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26627d-9e57-4162-be75-54b1b687ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.692641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26627d-9e57-4162-be75-54b1b687ff6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.707807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26627d-9e57-4162-be75-54b1b687ff6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:25.710706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26627d-9e57-4162-be75-54b1b687ff6d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:25.718978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7269d-46bf-4f5b-837b-b92fc580b3ff None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-ec26627d-9e57-4162-be75-54b1b687ff6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:25.734420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:25.735343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:25.736233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:25.736233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:25.736233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:25.736233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:25.744101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 440/890] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:25.745003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26627d-9e57-4162-be75-54b1b687ff6d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:25.761759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e6dce-1e9b-45b4-a03d-6075f73a45c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:25.762564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e6dce-1e9b-45b4-a03d-6075f73a45c2 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.762908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e6dce-1e9b-45b4-a03d-6075f73a45c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.763248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e6dce-1e9b-45b4-a03d-6075f73a45c2 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.764036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e6dce-1e9b-45b4-a03d-6075f73a45c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:25.764436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e6dce-1e9b-45b4-a03d-6075f73a45c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:25.766124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e6dce-1e9b-45b4-a03d-6075f73a45c2 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:25.776438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 451/891] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:25.778317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e6dce-1e9b-45b4-a03d-6075f73a45c2 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:25.827333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:25.834653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:25.867376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26627d-9e57-4162-be75-54b1b687ff6d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:25.886331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e6dce-1e9b-45b4-a03d-6075f73a45c2 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:25.904727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ba131-332e-4b76-b444-498c087abb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:25.905728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba131-332e-4b76-b444-498c087abb18 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.906194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba131-332e-4b76-b444-498c087abb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.906732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba131-332e-4b76-b444-498c087abb18 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.907605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ba131-332e-4b76-b444-498c087abb18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:25.908079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ba131-332e-4b76-b444-498c087abb18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:25.909773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ba131-332e-4b76-b444-498c087abb18 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:25.924197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ea8b1-8134-4a95-afc6-d1c7eed74e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:25.928331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ea8b1-8134-4a95-afc6-d1c7eed74e88 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:25.928331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ea8b1-8134-4a95-afc6-d1c7eed74e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:25.928331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ea8b1-8134-4a95-afc6-d1c7eed74e88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:25.928331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ea8b1-8134-4a95-afc6-d1c7eed74e88 None admin] RBAC: Adding query filter params (interface=public, service_id=117223dde62e4d8fabb46cf5c75025eb, region_id=RegionOne) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:25.928331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ea8b1-8134-4a95-afc6-d1c7eed74e88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:25.928331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ea8b1-8134-4a95-afc6-d1c7eed74e88 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:25.929341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 441/892] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:25.931893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ba131-332e-4b76-b444-498c087abb18 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:25.938095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 452/893] 10.222.0.74 () {56 vars in 1251 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/endpoints?service_id=117223dde62e4d8fabb46cf5c75025eb&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:25.939027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ea8b1-8134-4a95-afc6-d1c7eed74e88 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:26.046556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ea8b1-8134-4a95-afc6-d1c7eed74e88 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:26.049941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ba131-332e-4b76-b444-498c087abb18 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:26.063921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:26.079411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:26.083864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8a8ce-8375-410b-880b-847a2d5e98bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:26.084500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8a8ce-8375-410b-880b-847a2d5e98bc None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:26.084788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8a8ce-8375-410b-880b-847a2d5e98bc None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:26.085046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8a8ce-8375-410b-880b-847a2d5e98bc None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:26.085724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8a8ce-8375-410b-880b-847a2d5e98bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:26.087404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8a8ce-8375-410b-880b-847a2d5e98bc None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:26.089570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b2c4-5494-4f49-8349-9f04b0c573d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:26.090560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b2c4-5494-4f49-8349-9f04b0c573d8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:26.090989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b2c4-5494-4f49-8349-9f04b0c573d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:26.091410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b2c4-5494-4f49-8349-9f04b0c573d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:26.100443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094b2c4-5494-4f49-8349-9f04b0c573d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:26.101054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 453/894] 10.222.0.74 () {56 vars in 1087 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:27:26.102395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094b2c4-5494-4f49-8349-9f04b0c573d8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-7094b2c4-5494-4f49-8349-9f04b0c573d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:26.120183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:26.121480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:26.122697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:26.125377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 442/895] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:27:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:26.131234 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8a8ce-8375-410b-880b-847a2d5e98bc None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:26.250136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8a8ce-8375-410b-880b-847a2d5e98bc None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:26.290257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae409c5-b79f-4b4e-93f3-66c27936a243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:26.290257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae409c5-b79f-4b4e-93f3-66c27936a243 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:26.290257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae409c5-b79f-4b4e-93f3-66c27936a243 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:26.290257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae409c5-b79f-4b4e-93f3-66c27936a243 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:26.291084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae409c5-b79f-4b4e-93f3-66c27936a243 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:26.291398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae409c5-b79f-4b4e-93f3-66c27936a243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:26.292981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae409c5-b79f-4b4e-93f3-66c27936a243 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:26.312460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 454/896] 10.222.0.74 () {56 vars in 1149 bytes} [Mon May 23 16:27:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:26.317836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b2c4-5494-4f49-8349-9f04b0c573d8 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:26.427667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b2c4-5494-4f49-8349-9f04b0c573d8 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:26.464831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334f338-4a59-4cb8-b050-964b1be3b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:26.465490 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334f338-4a59-4cb8-b050-964b1be3b13a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:26.465773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334f338-4a59-4cb8-b050-964b1be3b13a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:26.466050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334f338-4a59-4cb8-b050-964b1be3b13a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:26.524449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:26.538766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334f338-4a59-4cb8-b050-964b1be3b13a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:26.540240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334f338-4a59-4cb8-b050-964b1be3b13a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:26.647680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 443/897] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:26 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:27:26.657280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae409c5-b79f-4b4e-93f3-66c27936a243 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:26.699670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:26.763462 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae409c5-b79f-4b4e-93f3-66c27936a243 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:26.799804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbf609-ecc8-46a9-a848-febc12e3170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:26.801199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbf609-ecc8-46a9-a848-febc12e3170d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:26.801800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbf609-ecc8-46a9-a848-febc12e3170d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:26.802272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbf609-ecc8-46a9-a848-febc12e3170d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:26.813143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbf609-ecc8-46a9-a848-febc12e3170d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:26.814875 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbf609-ecc8-46a9-a848-febc12e3170d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-6fcbf609-ecc8-46a9-a848-febc12e3170d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:26.834542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:26.835501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:26.836456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:26.836456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:26.836456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:26.836456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:26.838710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 455/898] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:26.841110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4e6a2-bcc4-4738-bd7c-2fa7dad7f421 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:26.841609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4e6a2-bcc4-4738-bd7c-2fa7dad7f421 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:26.842101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4e6a2-bcc4-4738-bd7c-2fa7dad7f421 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:26.843956 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbf609-ecc8-46a9-a848-febc12e3170d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:26.844435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 444/899] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:26.850547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a9fe-4491-4e5b-85cf-aea63f3ae51d None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:26.851181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a9fe-4491-4e5b-85cf-aea63f3ae51d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:26.851665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a9fe-4491-4e5b-85cf-aea63f3ae51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:26.873783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-3239a9fe-4491-4e5b-85cf-aea63f3ae51d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:26.875866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3239a9fe-4491-4e5b-85cf-aea63f3ae51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:26.964198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 445/900] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:26.981795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:26.986380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a9fe-4491-4e5b-85cf-aea63f3ae51d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:26.994277 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbf609-ecc8-46a9-a848-febc12e3170d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.016681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:27.046450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a8d3-bf5a-459c-b38f-97cdb14e8a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.047596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a8d3-bf5a-459c-b38f-97cdb14e8a0e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.048132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a8d3-bf5a-459c-b38f-97cdb14e8a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.048275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a8d3-bf5a-459c-b38f-97cdb14e8a0e None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.049362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423a8d3-bf5a-459c-b38f-97cdb14e8a0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:27.049749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423a8d3-bf5a-459c-b38f-97cdb14e8a0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.052234 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423a8d3-bf5a-459c-b38f-97cdb14e8a0e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:27.068705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 456/901] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:27.074273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a8d3-bf5a-459c-b38f-97cdb14e8a0e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:27.108575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a9fe-4491-4e5b-85cf-aea63f3ae51d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.155142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b280d-9b31-4f86-aef8-c69f21ef3c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.155960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b280d-9b31-4f86-aef8-c69f21ef3c47 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.156241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b280d-9b31-4f86-aef8-c69f21ef3c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.156547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b280d-9b31-4f86-aef8-c69f21ef3c47 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.157201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b280d-9b31-4f86-aef8-c69f21ef3c47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.159098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b280d-9b31-4f86-aef8-c69f21ef3c47 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-d00b280d-9b31-4f86-aef8-c69f21ef3c47 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:27.175722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:27.177549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:27:27.178810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:27.181910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 446/902] 10.222.0.74 () {56 vars in 1132 bytes} [Mon May 23 16:27:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:27.184240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b280d-9b31-4f86-aef8-c69f21ef3c47 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:27.202533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a8d3-bf5a-459c-b38f-97cdb14e8a0e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.258988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abcc71-5485-4e8c-b79e-02ee59b3454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.259800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abcc71-5485-4e8c-b79e-02ee59b3454e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.260081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abcc71-5485-4e8c-b79e-02ee59b3454e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.260899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abcc71-5485-4e8c-b79e-02ee59b3454e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.271518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abcc71-5485-4e8c-b79e-02ee59b3454e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.273323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abcc71-5485-4e8c-b79e-02ee59b3454e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:27.293780 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-25abcc71-5485-4e8c-b79e-02ee59b3454e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:27.294748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:27.295836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:27.296864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:27.296864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:27.296864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:27.296864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:27.296864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:27.296864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:27.296864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:27.296864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:27.296864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 457/903] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:27.302607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abcc71-5485-4e8c-b79e-02ee59b3454e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:27.315615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:27.322114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b280d-9b31-4f86-aef8-c69f21ef3c47 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.360269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19813b43-735d-4f06-8b1b-ab982b7b04bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.361285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19813b43-735d-4f06-8b1b-ab982b7b04bf None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.361775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19813b43-735d-4f06-8b1b-ab982b7b04bf None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.362230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19813b43-735d-4f06-8b1b-ab982b7b04bf None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.363811 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19813b43-735d-4f06-8b1b-ab982b7b04bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:27.364349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19813b43-735d-4f06-8b1b-ab982b7b04bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.365920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19813b43-735d-4f06-8b1b-ab982b7b04bf None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:27.371597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 447/904] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:27.377023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19813b43-735d-4f06-8b1b-ab982b7b04bf None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:27.415880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abcc71-5485-4e8c-b79e-02ee59b3454e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.457105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef2bdf-c094-453a-8039-0caf3459bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.457801 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef2bdf-c094-453a-8039-0caf3459bab4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.458040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef2bdf-c094-453a-8039-0caf3459bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.458316 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef2bdf-c094-453a-8039-0caf3459bab4 None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.459101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef2bdf-c094-453a-8039-0caf3459bab4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:27.459410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef2bdf-c094-453a-8039-0caf3459bab4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.460910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef2bdf-c094-453a-8039-0caf3459bab4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:27.472953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 458/905] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:27.474147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d4f53-92ff-4f1e-93c9-21a383359c54 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.474434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d4f53-92ff-4f1e-93c9-21a383359c54 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.474709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d4f53-92ff-4f1e-93c9-21a383359c54 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.476093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 459/906] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:27.483148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2677f7a-d32c-402b-bdc8-829857a7ecba None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.483630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2677f7a-d32c-402b-bdc8-829857a7ecba None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.483916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2677f7a-d32c-402b-bdc8-829857a7ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.495028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19813b43-735d-4f06-8b1b-ab982b7b04bf None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.500773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d2677f7a-d32c-402b-bdc8-829857a7ecba None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:27.501954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d2677f7a-d32c-402b-bdc8-829857a7ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:27.535131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88802ed-a3d0-4e12-9718-1c19f667cc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.536071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88802ed-a3d0-4e12-9718-1c19f667cc20 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.536594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88802ed-a3d0-4e12-9718-1c19f667cc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.537045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88802ed-a3d0-4e12-9718-1c19f667cc20 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.537930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88802ed-a3d0-4e12-9718-1c19f667cc20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:27.538420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88802ed-a3d0-4e12-9718-1c19f667cc20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.539990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88802ed-a3d0-4e12-9718-1c19f667cc20 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:27.545245 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 448/907] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:27.546253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88802ed-a3d0-4e12-9718-1c19f667cc20 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:27.560982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:27.574250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:27.578618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 460/908] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:27.588531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2677f7a-d32c-402b-bdc8-829857a7ecba None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:27.684067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2677f7a-d32c-402b-bdc8-829857a7ecba None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.687330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88802ed-a3d0-4e12-9718-1c19f667cc20 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.721344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde9c2b-4ead-4978-9678-b10fb3927d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.722062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde9c2b-4ead-4978-9678-b10fb3927d16 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.722324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde9c2b-4ead-4978-9678-b10fb3927d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.722603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde9c2b-4ead-4978-9678-b10fb3927d16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.723449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde9c2b-4ead-4978-9678-b10fb3927d16 None admin] RBAC: Adding query filter params (interface=public, service_id=077854e09f6040bb8c81b6b6fd2b505e, region_id=RegionOne) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:27.723712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde9c2b-4ead-4978-9678-b10fb3927d16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.724580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a808bb-c91d-42fe-9067-746b665643d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.725130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde9c2b-4ead-4978-9678-b10fb3927d16 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:27.725318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a808bb-c91d-42fe-9067-746b665643d0 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.725502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a808bb-c91d-42fe-9067-746b665643d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.725775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a808bb-c91d-42fe-9067-746b665643d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.726629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a808bb-c91d-42fe-9067-746b665643d0 None admin] RBAC: Adding query filter params (role.id=20e7b7e974a34b60917b112f4314ba18, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=d673b38649fe44059ae0257df02ed61f) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:27.726936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a808bb-c91d-42fe-9067-746b665643d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.728372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a808bb-c91d-42fe-9067-746b665643d0 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:27.730960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 461/909] 10.222.0.74 () {56 vars in 1251 bytes} [Mon May 23 16:27:27 2022] GET /identity/v3/endpoints?service_id=077854e09f6040bb8c81b6b6fd2b505e&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:27.740618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 449/910] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:27 2022] GET /identity/v3/role_assignments?user.id=d673b38649fe44059ae0257df02ed61f&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=20e7b7e974a34b60917b112f4314ba18 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:27.740618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a808bb-c91d-42fe-9067-746b665643d0 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:27.740895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde9c2b-4ead-4978-9678-b10fb3927d16 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:27.824236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:27.828887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:27.870021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a808bb-c91d-42fe-9067-746b665643d0 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.876449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde9c2b-4ead-4978-9678-b10fb3927d16 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:27.911733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634582-be71-4f1d-9799-80377281d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.912685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634582-be71-4f1d-9799-80377281d318 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.912972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634582-be71-4f1d-9799-80377281d318 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.913248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634582-be71-4f1d-9799-80377281d318 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.913963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0634582-be71-4f1d-9799-80377281d318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.915371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0634582-be71-4f1d-9799-80377281d318 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:27.926019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500f4dd-3e9a-406a-b816-195006d33b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:27.927084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500f4dd-3e9a-406a-b816-195006d33b25 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:27.927604 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500f4dd-3e9a-406a-b816-195006d33b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:27.928168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500f4dd-3e9a-406a-b816-195006d33b25 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:27.928754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 450/911] 10.222.0.74 () {56 vars in 1087 bytes} [Mon May 23 16:27:27 2022] GET /identity/v3/services => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:27:27.929528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500f4dd-3e9a-406a-b816-195006d33b25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:27.931228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500f4dd-3e9a-406a-b816-195006d33b25 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:28.006868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 462/912] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:27:27 2022] POST /identity/v3/services => generated 241 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:28.419196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199040b3-9a6f-4920-954e-5281d596dbe9 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:28.419770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199040b3-9a6f-4920-954e-5281d596dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:28.419770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199040b3-9a6f-4920-954e-5281d596dbe9 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:28.421376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 451/913] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:28.427454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7769ca-bf8d-4c15-b333-31aec527f208 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:28.427891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7769ca-bf8d-4c15-b333-31aec527f208 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:28.428043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7769ca-bf8d-4c15-b333-31aec527f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:28.445701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-ce7769ca-bf8d-4c15-b333-31aec527f208 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:28.446882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ce7769ca-bf8d-4c15-b333-31aec527f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:28.528798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 463/914] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:28.551184 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199040b3-9a6f-4920-954e-5281d596dbe9 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:28.660669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199040b3-9a6f-4920-954e-5281d596dbe9 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:28.698597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86da9f-fd7d-407d-af7a-fb07c5294fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:28.699643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86da9f-fd7d-407d-af7a-fb07c5294fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:28.700140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86da9f-fd7d-407d-af7a-fb07c5294fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:28.700592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86da9f-fd7d-407d-af7a-fb07c5294fa4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:28.708195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86da9f-fd7d-407d-af7a-fb07c5294fa4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:28.708195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86da9f-fd7d-407d-af7a-fb07c5294fa4 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:28.708195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-1e86da9f-fd7d-407d-af7a-fb07c5294fa4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:28.717127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:28.718321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 16:27:28.719363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:28.721864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 452/915] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:27:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:28.729486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7769ca-bf8d-4c15-b333-31aec527f208 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:28.781797 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:28.835448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7769ca-bf8d-4c15-b333-31aec527f208 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:28.870966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497321-2c99-425b-8c7f-0416c94b0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:28.871912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497321-2c99-425b-8c7f-0416c94b0de1 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:28.872447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497321-2c99-425b-8c7f-0416c94b0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:28.872874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497321-2c99-425b-8c7f-0416c94b0de1 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:28.873732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03497321-2c99-425b-8c7f-0416c94b0de1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:28.874188 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03497321-2c99-425b-8c7f-0416c94b0de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:28.875723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03497321-2c99-425b-8c7f-0416c94b0de1 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:28.881851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 464/916] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:27:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:28.889384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86da9f-fd7d-407d-af7a-fb07c5294fa4 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:28.996382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86da9f-fd7d-407d-af7a-fb07c5294fa4 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:29.031845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675756f-174d-40e3-a848-9b4f0944d133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:29.032815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675756f-174d-40e3-a848-9b4f0944d133 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:29.033251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675756f-174d-40e3-a848-9b4f0944d133 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:29.033677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675756f-174d-40e3-a848-9b4f0944d133 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:29.035098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675756f-174d-40e3-a848-9b4f0944d133 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:29.035699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675756f-174d-40e3-a848-9b4f0944d133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:29.037344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675756f-174d-40e3-a848-9b4f0944d133 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:29.042911 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 453/917] 10.222.0.74 () {56 vars in 1114 bytes} [Mon May 23 16:27:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:29.049425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497321-2c99-425b-8c7f-0416c94b0de1 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:29.153593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497321-2c99-425b-8c7f-0416c94b0de1 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:29.175985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:29.202381 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49c1ae-6631-4e09-89d6-d74715d3e64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:29.203320 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49c1ae-6631-4e09-89d6-d74715d3e64d None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:29.203756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49c1ae-6631-4e09-89d6-d74715d3e64d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:29.204183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49c1ae-6631-4e09-89d6-d74715d3e64d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:29.205093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49c1ae-6631-4e09-89d6-d74715d3e64d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:29.206697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49c1ae-6631-4e09-89d6-d74715d3e64d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:29.298963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 465/918] 10.222.0.74 () {60 vars in 1144 bytes} [Mon May 23 16:27:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:30.060902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4397840-4cd5-4ea4-bda5-2d004c64f671 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.061428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4397840-4cd5-4ea4-bda5-2d004c64f671 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.061508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4397840-4cd5-4ea4-bda5-2d004c64f671 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.062956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 454/919] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:30.069171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e3208-1ee4-48ed-a2fa-0bfb34b6e6aa None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.069171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e3208-1ee4-48ed-a2fa-0bfb34b6e6aa None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.069171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e3208-1ee4-48ed-a2fa-0bfb34b6e6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.088028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4a3e3208-1ee4-48ed-a2fa-0bfb34b6e6aa None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:30.089616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4a3e3208-1ee4-48ed-a2fa-0bfb34b6e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:30.183709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 466/920] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:30.207188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4397840-4cd5-4ea4-bda5-2d004c64f671 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:30.277003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:30.316343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5a939-ae85-4fd4-8e08-68eba80320dc None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.316570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5a939-ae85-4fd4-8e08-68eba80320dc None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.316681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4397840-4cd5-4ea4-bda5-2d004c64f671 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:30.316820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5a939-ae85-4fd4-8e08-68eba80320dc None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.318185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 467/921] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:30.323284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7b5f9-52ed-40fd-926c-b316f03a3b4d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.323569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7b5f9-52ed-40fd-926c-b316f03a3b4d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.323843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7b5f9-52ed-40fd-926c-b316f03a3b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.343315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-3fd7b5f9-52ed-40fd-926c-b316f03a3b4d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:30.344647 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3fd7b5f9-52ed-40fd-926c-b316f03a3b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:30.353586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431edb48-6d4a-400b-a11f-0f9a6e1cb852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:30.354402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edb48-6d4a-400b-a11f-0f9a6e1cb852 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.354689 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edb48-6d4a-400b-a11f-0f9a6e1cb852 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.354965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edb48-6d4a-400b-a11f-0f9a6e1cb852 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.366307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431edb48-6d4a-400b-a11f-0f9a6e1cb852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-431edb48-6d4a-400b-a11f-0f9a6e1cb852 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:30.374910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:30.376027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:30.376970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 455/922] 10.222.0.74 () {56 vars in 1120 bytes} [Mon May 23 16:27:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:30.378580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af8981-e844-4ace-a35e-4d116c8fb14d None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.378580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af8981-e844-4ace-a35e-4d116c8fb14d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.378705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af8981-e844-4ace-a35e-4d116c8fb14d None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.380172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 456/923] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:30.382601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af8981-e844-4ace-a35e-4d116c8fb14d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:30.424222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 468/924] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:30.425702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ddc53-5e5d-416d-8eb1-a1682ff61cc9 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.425993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ddc53-5e5d-416d-8eb1-a1682ff61cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.426271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ddc53-5e5d-416d-8eb1-a1682ff61cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.444571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a40ddc53-5e5d-416d-8eb1-a1682ff61cc9 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:30.445948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a40ddc53-5e5d-416d-8eb1-a1682ff61cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:30.470566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:30.494851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af8981-e844-4ace-a35e-4d116c8fb14d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:30.521649 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:30.525051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 469/925] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:30.525777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ddc53-5e5d-416d-8eb1-a1682ff61cc9 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:30.547734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee0ba-b1a2-4be0-a5c0-e1bb87fa64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:30.548450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee0ba-b1a2-4be0-a5c0-e1bb87fa64ad None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.549037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee0ba-b1a2-4be0-a5c0-e1bb87fa64ad None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.549321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee0ba-b1a2-4be0-a5c0-e1bb87fa64ad None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.550632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee0ba-b1a2-4be0-a5c0-e1bb87fa64ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:30.550997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee0ba-b1a2-4be0-a5c0-e1bb87fa64ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:30.552835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee0ba-b1a2-4be0-a5c0-e1bb87fa64ad None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:30.566578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 457/926] 10.222.0.74 () {56 vars in 1115 bytes} [Mon May 23 16:27:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:30.566578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee0ba-b1a2-4be0-a5c0-e1bb87fa64ad None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:30.642157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ddc53-5e5d-416d-8eb1-a1682ff61cc9 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:30.673385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee0ba-b1a2-4be0-a5c0-e1bb87fa64ad None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:30.679783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d353f-055b-48e7-8294-df462c5c3044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:30.680695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d353f-055b-48e7-8294-df462c5c3044 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.681067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d353f-055b-48e7-8294-df462c5c3044 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.681416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d353f-055b-48e7-8294-df462c5c3044 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.682066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d353f-055b-48e7-8294-df462c5c3044 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:30.683437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d353f-055b-48e7-8294-df462c5c3044 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-219d353f-055b-48e7-8294-df462c5c3044 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:30.695795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:30.696901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:30.697791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 470/927] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:30.698594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d353f-055b-48e7-8294-df462c5c3044 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:30.712982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da92b86-2ab2-49c9-9eb5-3bace2a77329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:30.713794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92b86-2ab2-49c9-9eb5-3bace2a77329 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.714074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92b86-2ab2-49c9-9eb5-3bace2a77329 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.714349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92b86-2ab2-49c9-9eb5-3bace2a77329 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.715072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da92b86-2ab2-49c9-9eb5-3bace2a77329 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:30.716437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da92b86-2ab2-49c9-9eb5-3bace2a77329 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:30.724238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-3da92b86-2ab2-49c9-9eb5-3bace2a77329 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:30.730699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:30.734306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:30.735168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 458/928] 10.222.0.74 () {56 vars in 1132 bytes} [Mon May 23 16:27:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:30.736026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da92b86-2ab2-49c9-9eb5-3bace2a77329 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:30.791638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:30.814311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d353f-055b-48e7-8294-df462c5c3044 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:30.846373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da92b86-2ab2-49c9-9eb5-3bace2a77329 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:30.850779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda521f7-36aa-44e1-a927-dac4c89c263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:30.851580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda521f7-36aa-44e1-a927-dac4c89c263d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.851862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda521f7-36aa-44e1-a927-dac4c89c263d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.852139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda521f7-36aa-44e1-a927-dac4c89c263d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.862776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda521f7-36aa-44e1-a927-dac4c89c263d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:30.864227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda521f7-36aa-44e1-a927-dac4c89c263d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-eda521f7-36aa-44e1-a927-dac4c89c263d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:30.882052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:30.882951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:30.883830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:30.883830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:30.883830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:30.883830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:30.884061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba7865-c9ef-48b5-9f4d-0478e464254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:30.884156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 471/929] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:30.884673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda521f7-36aa-44e1-a927-dac4c89c263d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:30.888540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba7865-c9ef-48b5-9f4d-0478e464254c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.888540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba7865-c9ef-48b5-9f4d-0478e464254c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.888763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba7865-c9ef-48b5-9f4d-0478e464254c None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.889322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba7865-c9ef-48b5-9f4d-0478e464254c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:30.889641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba7865-c9ef-48b5-9f4d-0478e464254c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:30.891279 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba7865-c9ef-48b5-9f4d-0478e464254c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:30.897359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 459/930] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:30.898235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba7865-c9ef-48b5-9f4d-0478e464254c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:30.970209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.004821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda521f7-36aa-44e1-a927-dac4c89c263d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.006867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba7865-c9ef-48b5-9f4d-0478e464254c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.022844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.041788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd914aa-a208-4867-9887-42ebc46cd290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.042544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd914aa-a208-4867-9887-42ebc46cd290 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.042912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd914aa-a208-4867-9887-42ebc46cd290 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.043187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd914aa-a208-4867-9887-42ebc46cd290 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.043363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304731-8686-4414-8cfb-50d233dabc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.043938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd914aa-a208-4867-9887-42ebc46cd290 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:31.044048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304731-8686-4414-8cfb-50d233dabc4a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.044244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd914aa-a208-4867-9887-42ebc46cd290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.044368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304731-8686-4414-8cfb-50d233dabc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.044552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304731-8686-4414-8cfb-50d233dabc4a None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.045274 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304731-8686-4414-8cfb-50d233dabc4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:31.045591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304731-8686-4414-8cfb-50d233dabc4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.045690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd914aa-a208-4867-9887-42ebc46cd290 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.046939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304731-8686-4414-8cfb-50d233dabc4a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.055276 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 472/931] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:31.055276 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd914aa-a208-4867-9887-42ebc46cd290 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.059661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 460/932] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:31.060759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304731-8686-4414-8cfb-50d233dabc4a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.159938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd914aa-a208-4867-9887-42ebc46cd290 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.163402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304731-8686-4414-8cfb-50d233dabc4a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.195846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a397723-c220-4193-8d5d-df9f67b9e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.197124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397723-c220-4193-8d5d-df9f67b9e564 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.197408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397723-c220-4193-8d5d-df9f67b9e564 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.197684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397723-c220-4193-8d5d-df9f67b9e564 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.198390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a397723-c220-4193-8d5d-df9f67b9e564 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:31.198755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a397723-c220-4193-8d5d-df9f67b9e564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.200060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a397723-c220-4193-8d5d-df9f67b9e564 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.201264 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe53193-ea59-45c2-a019-72ea1db67f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.201931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe53193-ea59-45c2-a019-72ea1db67f75 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.202221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe53193-ea59-45c2-a019-72ea1db67f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.202497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe53193-ea59-45c2-a019-72ea1db67f75 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.202620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.203208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe53193-ea59-45c2-a019-72ea1db67f75 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:31.203555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe53193-ea59-45c2-a019-72ea1db67f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.204928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe53193-ea59-45c2-a019-72ea1db67f75 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.210845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 473/933] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:31.210845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a397723-c220-4193-8d5d-df9f67b9e564 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.224579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 461/934] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:31.224579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe53193-ea59-45c2-a019-72ea1db67f75 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.273541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.311190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a397723-c220-4193-8d5d-df9f67b9e564 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.336831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe53193-ea59-45c2-a019-72ea1db67f75 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.348409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1aa6a-8cfe-4da2-9c31-332cd01c0f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.349230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1aa6a-8cfe-4da2-9c31-332cd01c0f7f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.349511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1aa6a-8cfe-4da2-9c31-332cd01c0f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.349948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1aa6a-8cfe-4da2-9c31-332cd01c0f7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.358727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1aa6a-8cfe-4da2-9c31-332cd01c0f7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.360359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1aa6a-8cfe-4da2-9c31-332cd01c0f7f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.375173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749473-2ce1-44db-92e7-121b2735f7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.375837 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749473-2ce1-44db-92e7-121b2735f7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-eef1aa6a-8cfe-4da2-9c31-332cd01c0f7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:31.375943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:31.376852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:31.377839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:31.379015 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749473-2ce1-44db-92e7-121b2735f7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.379015 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749473-2ce1-44db-92e7-121b2735f7f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.379015 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4749473-2ce1-44db-92e7-121b2735f7f6 None admin] RBAC: Adding query filter params (interface=public, service_id=38fbaa0f30b646edbec3db0a0f863659, region_id=RegionOne) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:31.379015 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4749473-2ce1-44db-92e7-121b2735f7f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.379784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4749473-2ce1-44db-92e7-121b2735f7f6 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.382436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 474/935] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:27:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:31.383262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1aa6a-8cfe-4da2-9c31-332cd01c0f7f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.390252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 462/936] 10.222.0.74 () {56 vars in 1251 bytes} [Mon May 23 16:27:31 2022] GET /identity/v3/endpoints?service_id=38fbaa0f30b646edbec3db0a0f863659&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:31.390252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749473-2ce1-44db-92e7-121b2735f7f6 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.458691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.496008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749473-2ce1-44db-92e7-121b2735f7f6 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.497684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.502004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1aa6a-8cfe-4da2-9c31-332cd01c0f7f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.535922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfd7a1-3566-40d3-9060-dac67df29cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.536630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd7a1-3566-40d3-9060-dac67df29cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.536908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd7a1-3566-40d3-9060-dac67df29cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.537179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd7a1-3566-40d3-9060-dac67df29cc3 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.538016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfd7a1-3566-40d3-9060-dac67df29cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:31.538323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfd7a1-3566-40d3-9060-dac67df29cc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.539373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4682a-3638-4840-b499-aa846f1bbba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.539749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfd7a1-3566-40d3-9060-dac67df29cc3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.540035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4682a-3638-4840-b499-aa846f1bbba7 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.540345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4682a-3638-4840-b499-aa846f1bbba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.540632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4682a-3638-4840-b499-aa846f1bbba7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.541409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4682a-3638-4840-b499-aa846f1bbba7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.542806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4682a-3638-4840-b499-aa846f1bbba7 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.557571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 463/937] 10.222.0.74 () {56 vars in 1149 bytes} [Mon May 23 16:27:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:31.558401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfd7a1-3566-40d3-9060-dac67df29cc3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.642089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 475/938] 10.222.0.74 () {60 vars in 1144 bytes} [Mon May 23 16:27:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:31.642914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4682a-3638-4840-b499-aa846f1bbba7 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.667266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfd7a1-3566-40d3-9060-dac67df29cc3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.713863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca3564-1806-4737-a277-041947e25c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.714720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca3564-1806-4737-a277-041947e25c44 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.715002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca3564-1806-4737-a277-041947e25c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.715276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca3564-1806-4737-a277-041947e25c44 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.716021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca3564-1806-4737-a277-041947e25c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.718258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca3564-1806-4737-a277-041947e25c44 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.727436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 464/939] 10.222.0.74 () {56 vars in 1087 bytes} [Mon May 23 16:27:31 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:31.728832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca7635-ae7b-475c-bb48-a8a95ad3020c None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.729119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca7635-ae7b-475c-bb48-a8a95ad3020c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.729395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca7635-ae7b-475c-bb48-a8a95ad3020c None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.730986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 465/940] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:31.736904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91cbd-30f7-4d6d-8f14-5adcc5c030e2 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.737216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91cbd-30f7-4d6d-8f14-5adcc5c030e2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.737486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91cbd-30f7-4d6d-8f14-5adcc5c030e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.757214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-dcc91cbd-30f7-4d6d-8f14-5adcc5c030e2 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:31.758456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-dcc91cbd-30f7-4d6d-8f14-5adcc5c030e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:31.774111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4682a-3638-4840-b499-aa846f1bbba7 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.775735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.801695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.829245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e3340-80d9-41d2-a363-b37371835063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.830504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e3340-80d9-41d2-a363-b37371835063 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.831017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e3340-80d9-41d2-a363-b37371835063 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.831476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e3340-80d9-41d2-a363-b37371835063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.845281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e3340-80d9-41d2-a363-b37371835063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.848204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e3340-80d9-41d2-a363-b37371835063 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.853038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 466/941] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-174e3340-80d9-41d2-a363-b37371835063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:31.870008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:31.871052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:31.871948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:31.871948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:31.871948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:31.871948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:31.871948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 476/942] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:31.877237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91cbd-30f7-4d6d-8f14-5adcc5c030e2 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.878916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e3340-80d9-41d2-a363-b37371835063 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.998860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e3340-80d9-41d2-a363-b37371835063 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:32.021046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91cbd-30f7-4d6d-8f14-5adcc5c030e2 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:32.034543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b886ee4-bd69-4282-80e8-d6d17ce0c40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:32.035361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b886ee4-bd69-4282-80e8-d6d17ce0c40e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:32.035712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b886ee4-bd69-4282-80e8-d6d17ce0c40e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:32.036060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b886ee4-bd69-4282-80e8-d6d17ce0c40e None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:32.036877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b886ee4-bd69-4282-80e8-d6d17ce0c40e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:32.037251 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b886ee4-bd69-4282-80e8-d6d17ce0c40e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:32.038707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b886ee4-bd69-4282-80e8-d6d17ce0c40e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:32.051891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 477/943] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:32.057343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b886ee4-bd69-4282-80e8-d6d17ce0c40e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:32.068253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:32.069293 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:32.069774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:32.070255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:32.071165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:32.072844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:32.074468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WARNING keystone.server.flask.common [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 16:27:32.091603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:32.123487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.sql.core [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 16:27:32.123487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 16:27:32.123487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [parameters: {'id': '93c2b578550c4419a2f8576d92160d08', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 16:27:32.123487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80675) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 93c2b578550c4419a2f8576d92160d08.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 93c2b578550c4419a2f8576d92160d08. May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application conn.query(q) May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:27:32.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application result.read() May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 23 16:27:32.143546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return project_ref.to_dict() May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application next(self.gen) May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application yield resource May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application next(self.gen) May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.session.rollback() May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.force_reraise() May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise self.value May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application session.commit() May 23 16:27:32.144734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._prepare_impl() May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.session.flush() May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._flush(objects) May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application compat.raise_( May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application flush_context.execute() May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 16:27:32.145633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rec.execute(self) May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 16:27:32.147624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application conn.query(q) May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application result.read() May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:27:32.149530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [parameters: {'id': '93c2b578550c4419a2f8576d92160d08', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:32.151752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:32.153701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:32.156809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:32.156809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 23 16:27:32.156809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 23 16:27:32.156809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:32.156809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:32.156809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 23 16:27:32.156809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.Conflict( May 23 16:27:32.156809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 93c2b578550c4419a2f8576d92160d08. May 23 16:27:32.156809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:32.163954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 467/944] 10.222.0.74 () {60 vars in 1140 bytes} [Mon May 23 16:27:31 2022] POST /identity/v3/projects => generated 262 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:32.166468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:32.169734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b886ee4-bd69-4282-80e8-d6d17ce0c40e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:32.178757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:32.216402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c040-6773-4928-ab1b-0d91b1384631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:32.217651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c040-6773-4928-ab1b-0d91b1384631 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:32.218193 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c040-6773-4928-ab1b-0d91b1384631 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:32.218664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c040-6773-4928-ab1b-0d91b1384631 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:32.228677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098c040-6773-4928-ab1b-0d91b1384631 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:32.230444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098c040-6773-4928-ab1b-0d91b1384631 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-3098c040-6773-4928-ab1b-0d91b1384631 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:32.245729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:32.246675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:32.247654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:32.247654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:32.247654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:32.247654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:32.247654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:32.247654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:32.247654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:32.247654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:32.250174 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 478/945] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:32.256064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c040-6773-4928-ab1b-0d91b1384631 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:32.303468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a2f6-3528-471c-bfab-24b10c7956ae None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:32.338990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425e5cd-fcd4-407f-b355-ba7fa23ce74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:32.339786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425e5cd-fcd4-407f-b355-ba7fa23ce74b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:32.340067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425e5cd-fcd4-407f-b355-ba7fa23ce74b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:32.340379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425e5cd-fcd4-407f-b355-ba7fa23ce74b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:32.348255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425e5cd-fcd4-407f-b355-ba7fa23ce74b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:32.349950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425e5cd-fcd4-407f-b355-ba7fa23ce74b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-f425e5cd-fcd4-407f-b355-ba7fa23ce74b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:32.365840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:32.366813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:32.367737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:32.367737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:32.367737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:32.367737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:32.367737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:32.367737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:32.367737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:32.367737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:32.372080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 468/946] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:32.372998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425e5cd-fcd4-407f-b355-ba7fa23ce74b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:32.375265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:32.391974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c040-6773-4928-ab1b-0d91b1384631 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:32.433044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25daa-9d5a-4c50-ac9b-c312ab559a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:32.433738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25daa-9d5a-4c50-ac9b-c312ab559a09 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:32.433960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25daa-9d5a-4c50-ac9b-c312ab559a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:32.434232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25daa-9d5a-4c50-ac9b-c312ab559a09 None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:32.435017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25daa-9d5a-4c50-ac9b-c312ab559a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:32.435323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25daa-9d5a-4c50-ac9b-c312ab559a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:32.437003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25daa-9d5a-4c50-ac9b-c312ab559a09 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:32.455050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 479/947] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:32.456923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25daa-9d5a-4c50-ac9b-c312ab559a09 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:32.462730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:32.499967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425e5cd-fcd4-407f-b355-ba7fa23ce74b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:32.539633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed195a-c97e-476d-b2ef-5dd7b652e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:32.540626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed195a-c97e-476d-b2ef-5dd7b652e0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:32.541075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed195a-c97e-476d-b2ef-5dd7b652e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:32.541496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed195a-c97e-476d-b2ef-5dd7b652e0e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:32.542401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed195a-c97e-476d-b2ef-5dd7b652e0e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:32.542853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed195a-c97e-476d-b2ef-5dd7b652e0e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:32.544908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed195a-c97e-476d-b2ef-5dd7b652e0e1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:32.570698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25daa-9d5a-4c50-ac9b-c312ab559a09 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:32.572456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 469/948] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:32.615136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2f099-ea8d-4956-9371-cad005a27bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:32.616452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2f099-ea8d-4956-9371-cad005a27bf6 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:32.616883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2f099-ea8d-4956-9371-cad005a27bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:32.617323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2f099-ea8d-4956-9371-cad005a27bf6 None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/d673b38649fe44059ae0257df02ed61f/roles/20e7b7e974a34b60917b112f4314ba18` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:32.619855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2f099-ea8d-4956-9371-cad005a27bf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=d673b38649fe44059ae0257df02ed61f, role_id=20e7b7e974a34b60917b112f4314ba18)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:32.621519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2f099-ea8d-4956-9371-cad005a27bf6 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:32.697068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 480/949] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:27:32 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/d673b38649fe44059ae0257df02ed61f/roles/20e7b7e974a34b60917b112f4314ba18 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:34.682069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fea2f-ba92-42e6-9323-0765d02d555d None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:34.682596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fea2f-ba92-42e6-9323-0765d02d555d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:34.683024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fea2f-ba92-42e6-9323-0765d02d555d None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:34.686062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 470/950] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:34.691759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7fdf5-6782-4759-a335-8174614c4c39 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:34.692596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7fdf5-6782-4759-a335-8174614c4c39 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:34.692879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7fdf5-6782-4759-a335-8174614c4c39 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:34.693191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526e90b-9dd5-45ac-b06c-3697643666ee None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:34.693487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526e90b-9dd5-45ac-b06c-3697643666ee None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:34.693770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526e90b-9dd5-45ac-b06c-3697643666ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:34.694384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 481/951] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:34.699611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a623189-6046-49b8-a1da-524552fa4ef0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:34.700158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a623189-6046-49b8-a1da-524552fa4ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:34.700680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a623189-6046-49b8-a1da-524552fa4ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:34.712419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8526e90b-9dd5-45ac-b06c-3697643666ee None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:34.714159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8526e90b-9dd5-45ac-b06c-3697643666ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:34.719406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9a623189-6046-49b8-a1da-524552fa4ef0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:34.721019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9a623189-6046-49b8-a1da-524552fa4ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:34.724123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:34.799623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 471/952] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:34.808250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 482/953] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:34.819503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526e90b-9dd5-45ac-b06c-3697643666ee None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:34.835411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a623189-6046-49b8-a1da-524552fa4ef0 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:34.889300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:34.935199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526e90b-9dd5-45ac-b06c-3697643666ee None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:34.961110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a623189-6046-49b8-a1da-524552fa4ef0 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:34.974950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c42ae-53e7-4135-aea3-17b3990b3c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:34.975875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c42ae-53e7-4135-aea3-17b3990b3c4c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:34.976160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c42ae-53e7-4135-aea3-17b3990b3c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:34.976471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c42ae-53e7-4135-aea3-17b3990b3c4c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:34.977131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c42ae-53e7-4135-aea3-17b3990b3c4c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:34.978731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c42ae-53e7-4135-aea3-17b3990b3c4c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-3f9c42ae-53e7-4135-aea3-17b3990b3c4c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:34.992471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:34.993822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:34.994748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 472/954] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:34.995580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e7374-c22d-49a8-89ad-c5c19c8e3092 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:34.995580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e7374-c22d-49a8-89ad-c5c19c8e3092 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:34.995580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e7374-c22d-49a8-89ad-c5c19c8e3092 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.000762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 473/955] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:35.001044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e7374-c22d-49a8-89ad-c5c19c8e3092 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.002481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430761ff-ad90-4ba2-8a0f-1249855c9073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.003827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430761ff-ad90-4ba2-8a0f-1249855c9073 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.004109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430761ff-ad90-4ba2-8a0f-1249855c9073 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.004542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430761ff-ad90-4ba2-8a0f-1249855c9073 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.005365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430761ff-ad90-4ba2-8a0f-1249855c9073 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.006793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430761ff-ad90-4ba2-8a0f-1249855c9073 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-430761ff-ad90-4ba2-8a0f-1249855c9073 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:35.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:35.021044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:35.021991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 483/956] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:35.022800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a7ce7-faaf-4cef-821a-ef6bdd69de11 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.023055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a7ce7-faaf-4cef-821a-ef6bdd69de11 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.023155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a7ce7-faaf-4cef-821a-ef6bdd69de11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.028007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:35.039846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b35a7ce7-faaf-4cef-821a-ef6bdd69de11 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:35.041064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b35a7ce7-faaf-4cef-821a-ef6bdd69de11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:35.106939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e7374-c22d-49a8-89ad-c5c19c8e3092 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.107161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 484/957] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:35.108266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b26a-8f41-4b8b-ae7d-f601ac8f1b21 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.108586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b26a-8f41-4b8b-ae7d-f601ac8f1b21 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.108864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b26a-8f41-4b8b-ae7d-f601ac8f1b21 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.110113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 485/958] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:35.110799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b26a-8f41-4b8b-ae7d-f601ac8f1b21 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.137770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:35.152326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497692b-ff13-40fe-8646-11f9a802afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.152987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497692b-ff13-40fe-8646-11f9a802afb9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.153271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497692b-ff13-40fe-8646-11f9a802afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.153704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497692b-ff13-40fe-8646-11f9a802afb9 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.154345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497692b-ff13-40fe-8646-11f9a802afb9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:35.154677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497692b-ff13-40fe-8646-11f9a802afb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.156066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497692b-ff13-40fe-8646-11f9a802afb9 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.165415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 474/959] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:35.165415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85495915-a544-4fd5-bcff-41501bfee1b5 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.165415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85495915-a544-4fd5-bcff-41501bfee1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.165415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85495915-a544-4fd5-bcff-41501bfee1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.180798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-85495915-a544-4fd5-bcff-41501bfee1b5 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:35.181984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-85495915-a544-4fd5-bcff-41501bfee1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:35.218184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b26a-8f41-4b8b-ae7d-f601ac8f1b21 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.247380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:35.251753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 475/960] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:35.252024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604793-b09d-43ee-887d-e9626271b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.252647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85495915-a544-4fd5-bcff-41501bfee1b5 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.253282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604793-b09d-43ee-887d-e9626271b09d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.253678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604793-b09d-43ee-887d-e9626271b09d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.253953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604793-b09d-43ee-887d-e9626271b09d None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.254686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604793-b09d-43ee-887d-e9626271b09d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:35.254967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604793-b09d-43ee-887d-e9626271b09d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.256360 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604793-b09d-43ee-887d-e9626271b09d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.261072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 486/961] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:35.261848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604793-b09d-43ee-887d-e9626271b09d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.357859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85495915-a544-4fd5-bcff-41501bfee1b5 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.360866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604793-b09d-43ee-887d-e9626271b09d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.371991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:35.393102 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.393968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.394255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.394531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.394645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6782fb0-6949-474e-aafc-5fe5e438a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.395209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6782fb0-6949-474e-aafc-5fe5e438a123 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.395304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.395492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6782fb0-6949-474e-aafc-5fe5e438a123 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.395769 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6782fb0-6949-474e-aafc-5fe5e438a123 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.396508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6782fb0-6949-474e-aafc-5fe5e438a123 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:35.396681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.396815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6782fb0-6949-474e-aafc-5fe5e438a123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.398168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6782fb0-6949-474e-aafc-5fe5e438a123 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.402605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 487/962] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:35.403371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6782fb0-6949-474e-aafc-5fe5e438a123 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.443117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.sql.core [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 16:27:35.443117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 16:27:35.443117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [parameters: {'user_id': '51ca90025ebf4922a4fc317108198e98', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 16:27:35.443117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80675) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application conn.query(q) May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application result.read() May 23 16:27:35.451355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:27:35.455830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application next(self.gen) May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application yield resource May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application next(self.gen) May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.session.rollback() May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.force_reraise() May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise self.value May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application session.commit() May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 16:27:35.457068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._prepare_impl() May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.session.flush() May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._flush(objects) May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application compat.raise_( May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application flush_context.execute() May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rec.execute(self) May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 16:27:35.457983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application result = connection._execute_20( May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 16:27:35.459411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application result = self._query(query) May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application conn.query(q) May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application result.read() May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 16:27:35.460278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [parameters: {'user_id': '51ca90025ebf4922a4fc317108198e98', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:35.462973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 23 16:27:35.464989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 23 16:27:35.467170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 23 16:27:35.467170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 23 16:27:35.467170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 16:27:35.467170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 16:27:35.467170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 16:27:35.467170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:35.467170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 476/963] 10.222.0.74 () {60 vars in 1131 bytes} [Mon May 23 16:27:35 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:35.467170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.482203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:35.535513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6782fb0-6949-474e-aafc-5fe5e438a123 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.574761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2fe3-c2d4-49bc-a2cb-1736fed2f147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.575556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2fe3-c2d4-49bc-a2cb-1736fed2f147 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.575837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2fe3-c2d4-49bc-a2cb-1736fed2f147 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.576111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2fe3-c2d4-49bc-a2cb-1736fed2f147 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.576863 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e2fe3-c2d4-49bc-a2cb-1736fed2f147 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:35.577168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e2fe3-c2d4-49bc-a2cb-1736fed2f147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.578352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca782b7-c8ca-4e6f-b974-2d0dfc2f4087 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.578549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e2fe3-c2d4-49bc-a2cb-1736fed2f147 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.589317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 488/964] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:35.589317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2fe3-c2d4-49bc-a2cb-1736fed2f147 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.621438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d812e-773b-4065-93bd-cf62cbae97e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.622266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d812e-773b-4065-93bd-cf62cbae97e2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.622550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d812e-773b-4065-93bd-cf62cbae97e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.622834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d812e-773b-4065-93bd-cf62cbae97e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.634135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d812e-773b-4065-93bd-cf62cbae97e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-0d8d812e-773b-4065-93bd-cf62cbae97e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:35.642664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:35.643723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:35.644680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:35.645363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 477/965] 10.222.0.74 () {56 vars in 1120 bytes} [Mon May 23 16:27:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:35.645838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d812e-773b-4065-93bd-cf62cbae97e2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.687503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:35.705416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2fe3-c2d4-49bc-a2cb-1736fed2f147 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.732476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:35.743552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fe94c-7e2e-4cad-b5bf-d1694be8e282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.744611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe94c-7e2e-4cad-b5bf-d1694be8e282 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.745069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe94c-7e2e-4cad-b5bf-d1694be8e282 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.745530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe94c-7e2e-4cad-b5bf-d1694be8e282 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.753488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fe94c-7e2e-4cad-b5bf-d1694be8e282 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.754930 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fe94c-7e2e-4cad-b5bf-d1694be8e282 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.758163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d812e-773b-4065-93bd-cf62cbae97e2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-005fe94c-7e2e-4cad-b5bf-d1694be8e282 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:35.770240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:35.771231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:35.772194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 489/966] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:35.773427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fe94c-7e2e-4cad-b5bf-d1694be8e282 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.801974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe112c7-9c42-475c-8183-4a29894a1acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.802641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe112c7-9c42-475c-8183-4a29894a1acb None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.802941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe112c7-9c42-475c-8183-4a29894a1acb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.803197 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe112c7-9c42-475c-8183-4a29894a1acb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.804022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe112c7-9c42-475c-8183-4a29894a1acb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.805544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe112c7-9c42-475c-8183-4a29894a1acb None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.882316 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 478/967] 10.222.0.74 () {60 vars in 1144 bytes} [Mon May 23 16:27:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:35.883527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe112c7-9c42-475c-8183-4a29894a1acb None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:35.919735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fe94c-7e2e-4cad-b5bf-d1694be8e282 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.970427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0728cc1-dbba-47c1-bd30-3b6f312ca3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.971349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0728cc1-dbba-47c1-bd30-3b6f312ca3ae None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.971929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0728cc1-dbba-47c1-bd30-3b6f312ca3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.972450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0728cc1-dbba-47c1-bd30-3b6f312ca3ae None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.973645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0728cc1-dbba-47c1-bd30-3b6f312ca3ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:35.973960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0728cc1-dbba-47c1-bd30-3b6f312ca3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.975407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0728cc1-dbba-47c1-bd30-3b6f312ca3ae None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.985185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 490/968] 10.222.0.74 () {56 vars in 1115 bytes} [Mon May 23 16:27:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:35.991268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0728cc1-dbba-47c1-bd30-3b6f312ca3ae None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:36.028595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:36.047666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe112c7-9c42-475c-8183-4a29894a1acb None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:36.051374 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:36.102451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe494e-b1b6-4af7-9ef6-a17396ddab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:36.103231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe494e-b1b6-4af7-9ef6-a17396ddab21 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:36.103553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe494e-b1b6-4af7-9ef6-a17396ddab21 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:36.103854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe494e-b1b6-4af7-9ef6-a17396ddab21 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:36.104691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe494e-b1b6-4af7-9ef6-a17396ddab21 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:36.105001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe494e-b1b6-4af7-9ef6-a17396ddab21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:36.106680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe494e-b1b6-4af7-9ef6-a17396ddab21 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:36.129569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0728cc1-dbba-47c1-bd30-3b6f312ca3ae None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:36.149542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 479/969] 10.222.0.74 () {56 vars in 1101 bytes} [Mon May 23 16:27:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:36.172465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72713f3-69df-41de-872c-df633478d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:36.173444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72713f3-69df-41de-872c-df633478d110 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:36.173829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72713f3-69df-41de-872c-df633478d110 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:36.174208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72713f3-69df-41de-872c-df633478d110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:36.187861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72713f3-69df-41de-872c-df633478d110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:36.189570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72713f3-69df-41de-872c-df633478d110 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-e72713f3-69df-41de-872c-df633478d110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:36.212547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:36.213672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:36.214561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:36.214561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:36.214561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:36.214561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:36.216463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 491/970] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:36.225185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe494e-b1b6-4af7-9ef6-a17396ddab21 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:36.337181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe494e-b1b6-4af7-9ef6-a17396ddab21 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:36.374838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e73768-290c-4c85-ad2f-6526b598b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:36.375743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e73768-290c-4c85-ad2f-6526b598b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:36.376170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e73768-290c-4c85-ad2f-6526b598b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:36.376627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e73768-290c-4c85-ad2f-6526b598b4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:36.377349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e73768-290c-4c85-ad2f-6526b598b4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:36.378350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e73768-290c-4c85-ad2f-6526b598b4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:36.379567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e73768-290c-4c85-ad2f-6526b598b4f8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:36.391823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 480/971] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:36.398305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72713f3-69df-41de-872c-df633478d110 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:36.512396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:36.523203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72713f3-69df-41de-872c-df633478d110 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:36.559823 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd890b04-e79c-4b78-b010-1452a79d1409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:36.560966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd890b04-e79c-4b78-b010-1452a79d1409 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:36.561433 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd890b04-e79c-4b78-b010-1452a79d1409 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:36.561932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd890b04-e79c-4b78-b010-1452a79d1409 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:36.570396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd890b04-e79c-4b78-b010-1452a79d1409 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:36.572075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd890b04-e79c-4b78-b010-1452a79d1409 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-bd890b04-e79c-4b78-b010-1452a79d1409 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:36.588827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:36.589846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 16:27:36.590806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:36.597496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 492/972] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:27:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:36.599287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e73768-290c-4c85-ad2f-6526b598b4f8 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:36.626085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:36.718370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e73768-290c-4c85-ad2f-6526b598b4f8 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:36.756310 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e32b3-a827-4488-857c-72c2eae43da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:36.757034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e32b3-a827-4488-857c-72c2eae43da5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:36.757308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e32b3-a827-4488-857c-72c2eae43da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:36.757583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e32b3-a827-4488-857c-72c2eae43da5 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:36.758440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e32b3-a827-4488-857c-72c2eae43da5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:36.758748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e32b3-a827-4488-857c-72c2eae43da5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:36.760211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e32b3-a827-4488-857c-72c2eae43da5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:36.785536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 481/973] 10.222.0.74 () {56 vars in 1149 bytes} [Mon May 23 16:27:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:36.786910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd890b04-e79c-4b78-b010-1452a79d1409 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:36.888744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd890b04-e79c-4b78-b010-1452a79d1409 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:36.924510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b573b9-1a0f-4c32-aaf8-f7ceb5cdd501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:36.925281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b573b9-1a0f-4c32-aaf8-f7ceb5cdd501 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:36.925565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b573b9-1a0f-4c32-aaf8-f7ceb5cdd501 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:36.925839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b573b9-1a0f-4c32-aaf8-f7ceb5cdd501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:36.950493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:36.998049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b573b9-1a0f-4c32-aaf8-f7ceb5cdd501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:36.999779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b573b9-1a0f-4c32-aaf8-f7ceb5cdd501 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:37.112669 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 493/974] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:27:37.114893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e32b3-a827-4488-857c-72c2eae43da5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:37.189839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:37.235482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e32b3-a827-4488-857c-72c2eae43da5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:37.273689 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232abefa-ce61-4200-b3df-60403ee69a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:37.274493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232abefa-ce61-4200-b3df-60403ee69a26 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:37.274770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232abefa-ce61-4200-b3df-60403ee69a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:37.275129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232abefa-ce61-4200-b3df-60403ee69a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:37.287338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232abefa-ce61-4200-b3df-60403ee69a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:37.288926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232abefa-ce61-4200-b3df-60403ee69a26 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-232abefa-ce61-4200-b3df-60403ee69a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:37.307114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:37.309180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:37.310195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:37.310195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:37.310195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:37.310195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:37.310195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 482/975] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:37.314045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b573b9-1a0f-4c32-aaf8-f7ceb5cdd501 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:37.369435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:37.419550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b573b9-1a0f-4c32-aaf8-f7ceb5cdd501 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:37.456908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a48a-3614-47fd-b227-101d067cd4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:37.457486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a48a-3614-47fd-b227-101d067cd4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:37.457762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a48a-3614-47fd-b227-101d067cd4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:37.458031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a48a-3614-47fd-b227-101d067cd4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:37.461095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9a48a-3614-47fd-b227-101d067cd4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:37.463564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9a48a-3614-47fd-b227-101d067cd4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:37.467111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9a48a-3614-47fd-b227-101d067cd4a9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:37.484361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 494/976] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:37.485622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232abefa-ce61-4200-b3df-60403ee69a26 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:37.601504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232abefa-ce61-4200-b3df-60403ee69a26 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:37.627110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:37.642429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d81fa-459b-4ddd-87df-497fcae5e926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:37.643948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d81fa-459b-4ddd-87df-497fcae5e926 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:37.644480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d81fa-459b-4ddd-87df-497fcae5e926 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:37.644771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d81fa-459b-4ddd-87df-497fcae5e926 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:37.651552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d81fa-459b-4ddd-87df-497fcae5e926 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:37.653116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d81fa-459b-4ddd-87df-497fcae5e926 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-ad6d81fa-459b-4ddd-87df-497fcae5e926 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:37.675567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:37.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:37.677766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:37.677766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:37.677766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:37.677766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:37.677766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:37.677766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:37.677766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:37.677766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:37.684322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 483/977] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:37.686392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a48a-3614-47fd-b227-101d067cd4a9 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:37.760757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150339bb-547b-4fa6-a6d6-f054685c0fd4 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:37.761387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150339bb-547b-4fa6-a6d6-f054685c0fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:37.761387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150339bb-547b-4fa6-a6d6-f054685c0fd4 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:37.762755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 484/978] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:27:37.768005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c83e8-f9d7-4827-ae5d-9f2ea827ebd9 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:37.769185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c83e8-f9d7-4827-ae5d-9f2ea827ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:37.769468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c83e8-f9d7-4827-ae5d-9f2ea827ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:37.790436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-876c83e8-f9d7-4827-ae5d-9f2ea827ebd9 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:37.791968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-876c83e8-f9d7-4827-ae5d-9f2ea827ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:37.806911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a48a-3614-47fd-b227-101d067cd4a9 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:37.823207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:37.846518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8745f9c-8949-4e4b-a966-108f75c965da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:37.847204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8745f9c-8949-4e4b-a966-108f75c965da None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:37.847605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8745f9c-8949-4e4b-a966-108f75c965da None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:37.847895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8745f9c-8949-4e4b-a966-108f75c965da None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:37.848725 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8745f9c-8949-4e4b-a966-108f75c965da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:37.849039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8745f9c-8949-4e4b-a966-108f75c965da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:37.850476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8745f9c-8949-4e4b-a966-108f75c965da None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:37.863086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 495/979] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:37.868946 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8745f9c-8949-4e4b-a966-108f75c965da None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:37.876630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 485/980] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:37.898559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c83e8-f9d7-4827-ae5d-9f2ea827ebd9 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:37.982160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8745f9c-8949-4e4b-a966-108f75c965da None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:38.003606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c83e8-f9d7-4827-ae5d-9f2ea827ebd9 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:38.015604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:38.020272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666d84e-d0cf-4f7c-98c7-d8435914e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:38.020973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d84e-d0cf-4f7c-98c7-d8435914e5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:38.021244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d84e-d0cf-4f7c-98c7-d8435914e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:38.021521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d84e-d0cf-4f7c-98c7-d8435914e5c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:38.022351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666d84e-d0cf-4f7c-98c7-d8435914e5c5 None admin] RBAC: Adding query filter params (role.id=20e7b7e974a34b60917b112f4314ba18, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=d673b38649fe44059ae0257df02ed61f) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:38.022663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666d84e-d0cf-4f7c-98c7-d8435914e5c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:38.024082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666d84e-d0cf-4f7c-98c7-d8435914e5c5 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:38.031069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 496/981] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:37 2022] GET /identity/v3/role_assignments?user.id=d673b38649fe44059ae0257df02ed61f&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=20e7b7e974a34b60917b112f4314ba18 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:38.040945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52944d-ebf6-4024-95ce-4cf51128ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:38.041635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52944d-ebf6-4024-95ce-4cf51128ac15 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:38.041982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52944d-ebf6-4024-95ce-4cf51128ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:38.042258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52944d-ebf6-4024-95ce-4cf51128ac15 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:38.043031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52944d-ebf6-4024-95ce-4cf51128ac15 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:38.044494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52944d-ebf6-4024-95ce-4cf51128ac15 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:38.114764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 486/982] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:27:37 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:27:38.367016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dceac-05ac-4daa-bb91-4a77c99ad725 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:38.367236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dceac-05ac-4daa-bb91-4a77c99ad725 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:38.367521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dceac-05ac-4daa-bb91-4a77c99ad725 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:38.368976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 497/983] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:38.374111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb212-9b17-421b-b359-9df136905aef None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:38.374409 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb212-9b17-421b-b359-9df136905aef None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:38.374688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb212-9b17-421b-b359-9df136905aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:38.392365 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6daeb212-9b17-421b-b359-9df136905aef None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:38.394115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6daeb212-9b17-421b-b359-9df136905aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:38.469839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 487/984] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:38.492835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dceac-05ac-4daa-bb91-4a77c99ad725 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:38.536010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:38.599962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dceac-05ac-4daa-bb91-4a77c99ad725 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:38.633683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4db7a-09f7-4243-ac05-8d5ec88b262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:38.634410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4db7a-09f7-4243-ac05-8d5ec88b262e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:38.634690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4db7a-09f7-4243-ac05-8d5ec88b262e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:38.634963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4db7a-09f7-4243-ac05-8d5ec88b262e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:38.635609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4db7a-09f7-4243-ac05-8d5ec88b262e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:38.637004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4db7a-09f7-4243-ac05-8d5ec88b262e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-0fc4db7a-09f7-4243-ac05-8d5ec88b262e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:38.649987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:38.651003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:38.656629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 498/985] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:38.659662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb212-9b17-421b-b359-9df136905aef None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:38.755579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:38.762235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb212-9b17-421b-b359-9df136905aef None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:38.798317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8b721-5a48-454b-af4b-f6010b6b9a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:38.798986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b721-5a48-454b-af4b-f6010b6b9a70 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:38.799785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b721-5a48-454b-af4b-f6010b6b9a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:38.800060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b721-5a48-454b-af4b-f6010b6b9a70 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:38.800799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8b721-5a48-454b-af4b-f6010b6b9a70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:38.801105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8b721-5a48-454b-af4b-f6010b6b9a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:38.802537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8b721-5a48-454b-af4b-f6010b6b9a70 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:38.812012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 488/986] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:38.813700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4db7a-09f7-4243-ac05-8d5ec88b262e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:38.915180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4db7a-09f7-4243-ac05-8d5ec88b262e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:38.916686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:38.950260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089deffe-7eda-4957-aa7e-61f03dcbe4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:38.950928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089deffe-7eda-4957-aa7e-61f03dcbe4eb None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:38.951210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089deffe-7eda-4957-aa7e-61f03dcbe4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:38.951483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089deffe-7eda-4957-aa7e-61f03dcbe4eb None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:38.952190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089deffe-7eda-4957-aa7e-61f03dcbe4eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:38.952534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089deffe-7eda-4957-aa7e-61f03dcbe4eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:38.953897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089deffe-7eda-4957-aa7e-61f03dcbe4eb None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:38.964353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 499/987] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:38.965888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8b721-5a48-454b-af4b-f6010b6b9a70 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:39.068826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8b721-5a48-454b-af4b-f6010b6b9a70 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:39.109735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b899458-3fdc-42b3-a6c5-24cbe2f0e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:39.110392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899458-3fdc-42b3-a6c5-24cbe2f0e691 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:39.110672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899458-3fdc-42b3-a6c5-24cbe2f0e691 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:39.110946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899458-3fdc-42b3-a6c5-24cbe2f0e691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:39.111765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b899458-3fdc-42b3-a6c5-24cbe2f0e691 None admin] RBAC: Adding query filter params (interface=admin, service_id=38fbaa0f30b646edbec3db0a0f863659, region_id=RegionOne) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:39.112074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b899458-3fdc-42b3-a6c5-24cbe2f0e691 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:39.113463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b899458-3fdc-42b3-a6c5-24cbe2f0e691 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:39.118721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 489/988] 10.222.0.74 () {56 vars in 1249 bytes} [Mon May 23 16:27:38 2022] GET /identity/v3/endpoints?service_id=38fbaa0f30b646edbec3db0a0f863659&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:39.124104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089deffe-7eda-4957-aa7e-61f03dcbe4eb None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:39.235958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089deffe-7eda-4957-aa7e-61f03dcbe4eb None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:39.279568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e75e8-5862-4819-a44b-c4ab6137456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:39.280261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e75e8-5862-4819-a44b-c4ab6137456f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:39.280575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e75e8-5862-4819-a44b-c4ab6137456f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:39.280851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e75e8-5862-4819-a44b-c4ab6137456f None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:39.281550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e75e8-5862-4819-a44b-c4ab6137456f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:39.282968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e75e8-5862-4819-a44b-c4ab6137456f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:39.290470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 500/989] 10.222.0.74 () {56 vars in 1087 bytes} [Mon May 23 16:27:39 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:40.309596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24a167-8e8f-4df5-84a0-684cb8efc082 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:40.310148 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24a167-8e8f-4df5-84a0-684cb8efc082 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:40.310148 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24a167-8e8f-4df5-84a0-684cb8efc082 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:40.311662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 490/990] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:40.317303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226223-b989-4795-93f9-11f032c26258 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:40.317735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226223-b989-4795-93f9-11f032c26258 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:40.317847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226223-b989-4795-93f9-11f032c26258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:40.334598 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c6226223-b989-4795-93f9-11f032c26258 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:40.335772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c6226223-b989-4795-93f9-11f032c26258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:40.360048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:40.408444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 501/991] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:40.417412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb5c72-9def-4eaa-bffb-a5c7fda2cfde None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:40.417779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb5c72-9def-4eaa-bffb-a5c7fda2cfde None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:40.418136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb5c72-9def-4eaa-bffb-a5c7fda2cfde None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:40.420338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 491/992] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:27:40.425957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297b8c5-8dd7-4693-ac34-e16f47c16f21 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:40.426250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297b8c5-8dd7-4693-ac34-e16f47c16f21 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:40.426658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297b8c5-8dd7-4693-ac34-e16f47c16f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:40.427797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb5c72-9def-4eaa-bffb-a5c7fda2cfde None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:40.444344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a297b8c5-8dd7-4693-ac34-e16f47c16f21 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:40.445575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a297b8c5-8dd7-4693-ac34-e16f47c16f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:40.457359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:40.516640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 502/993] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:40.539083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297b8c5-8dd7-4693-ac34-e16f47c16f21 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:40.546307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb5c72-9def-4eaa-bffb-a5c7fda2cfde None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:40.583349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00933469-bc86-47e2-a6a1-1b8e92ee9512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:40.584144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00933469-bc86-47e2-a6a1-1b8e92ee9512 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:40.584600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00933469-bc86-47e2-a6a1-1b8e92ee9512 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:40.585036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00933469-bc86-47e2-a6a1-1b8e92ee9512 None admin] PATH_INFO: `/v3/services/image` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:40.585526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00933469-bc86-47e2-a6a1-1b8e92ee9512 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:40.586893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00933469-bc86-47e2-a6a1-1b8e92ee9512 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-00933469-bc86-47e2-a6a1-1b8e92ee9512 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:40.598728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:40.599772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:40.600680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 492/994] 10.222.0.74 () {56 vars in 1105 bytes} [Mon May 23 16:27:40 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:40.605630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00933469-bc86-47e2-a6a1-1b8e92ee9512 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:40.641091 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:40.650503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297b8c5-8dd7-4693-ac34-e16f47c16f21 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:40.685720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800d811-f238-4b53-bf80-5db217431fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:40.686513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800d811-f238-4b53-bf80-5db217431fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:40.686799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800d811-f238-4b53-bf80-5db217431fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:40.687076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800d811-f238-4b53-bf80-5db217431fe0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:40.687732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800d811-f238-4b53-bf80-5db217431fe0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:40.689136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800d811-f238-4b53-bf80-5db217431fe0 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-c800d811-f238-4b53-bf80-5db217431fe0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:40.701084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:40.702121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:27:40.703026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:40.703783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:40.707436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 503/995] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:40.708289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800d811-f238-4b53-bf80-5db217431fe0 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:40.715939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00933469-bc86-47e2-a6a1-1b8e92ee9512 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:40.753841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef6dd9-eba2-42b0-bff9-522f7a6570f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:40.754508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef6dd9-eba2-42b0-bff9-522f7a6570f9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:40.754794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef6dd9-eba2-42b0-bff9-522f7a6570f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:40.755075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef6dd9-eba2-42b0-bff9-522f7a6570f9 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:40.755778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef6dd9-eba2-42b0-bff9-522f7a6570f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:40.756084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef6dd9-eba2-42b0-bff9-522f7a6570f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:40.757502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef6dd9-eba2-42b0-bff9-522f7a6570f9 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:40.762252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 493/996] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:40.768206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef6dd9-eba2-42b0-bff9-522f7a6570f9 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:40.835515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800d811-f238-4b53-bf80-5db217431fe0 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:40.871593 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef6dd9-eba2-42b0-bff9-522f7a6570f9 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:40.871808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13aa77-d8d0-48a0-a87f-e8a3e0c9db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:40.872307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13aa77-d8d0-48a0-a87f-e8a3e0c9db7a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:40.872680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13aa77-d8d0-48a0-a87f-e8a3e0c9db7a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:40.873068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13aa77-d8d0-48a0-a87f-e8a3e0c9db7a None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:40.873901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13aa77-d8d0-48a0-a87f-e8a3e0c9db7a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:40.874208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13aa77-d8d0-48a0-a87f-e8a3e0c9db7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:40.875589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13aa77-d8d0-48a0-a87f-e8a3e0c9db7a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:40.885824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 504/997] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:40.886839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13aa77-d8d0-48a0-a87f-e8a3e0c9db7a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:40.906106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:40.914841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dff0d8-8873-45e5-b4ea-b1af77d18b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:40.915664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dff0d8-8873-45e5-b4ea-b1af77d18b46 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:40.916329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dff0d8-8873-45e5-b4ea-b1af77d18b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:40.916618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dff0d8-8873-45e5-b4ea-b1af77d18b46 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:40.917508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dff0d8-8873-45e5-b4ea-b1af77d18b46 None admin] RBAC: Adding query filter params (type=image) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:40.917816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dff0d8-8873-45e5-b4ea-b1af77d18b46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:40.919212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dff0d8-8873-45e5-b4ea-b1af77d18b46 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:40.932324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 494/998] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:41.000709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13aa77-d8d0-48a0-a87f-e8a3e0c9db7a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:41.038822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae740c-d69d-4180-841d-7617dcf10545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:41.039414 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae740c-d69d-4180-841d-7617dcf10545 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:41.039698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae740c-d69d-4180-841d-7617dcf10545 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:41.039972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae740c-d69d-4180-841d-7617dcf10545 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:41.040724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae740c-d69d-4180-841d-7617dcf10545 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:41.041028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae740c-d69d-4180-841d-7617dcf10545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:41.042413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae740c-d69d-4180-841d-7617dcf10545 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:41.047971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 505/999] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:41.054576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dff0d8-8873-45e5-b4ea-b1af77d18b46 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:41.073914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:41.164121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dff0d8-8873-45e5-b4ea-b1af77d18b46 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:41.201110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e35fd-86d4-47b0-b5fc-db88900b9848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:41.202164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e35fd-86d4-47b0-b5fc-db88900b9848 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:41.202654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e35fd-86d4-47b0-b5fc-db88900b9848 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:41.203139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e35fd-86d4-47b0-b5fc-db88900b9848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:41.204132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e35fd-86d4-47b0-b5fc-db88900b9848 None admin] RBAC: Adding query filter params (interface=public, service_id=8bedd91741564f7bbabcf01fa249581d, region_id=RegionOne) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:41.204677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e35fd-86d4-47b0-b5fc-db88900b9848 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:41.206970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e35fd-86d4-47b0-b5fc-db88900b9848 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:41.213119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 495/1000] 10.222.0.74 () {56 vars in 1251 bytes} [Mon May 23 16:27:41 2022] GET /identity/v3/endpoints?service_id=8bedd91741564f7bbabcf01fa249581d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:41.219757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae740c-d69d-4180-841d-7617dcf10545 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:41.309702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:41.329807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae740c-d69d-4180-841d-7617dcf10545 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:41.365372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07092d5f-c308-4336-a072-c7094c1c8953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:41.366045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07092d5f-c308-4336-a072-c7094c1c8953 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:41.366326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07092d5f-c308-4336-a072-c7094c1c8953 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:41.366599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07092d5f-c308-4336-a072-c7094c1c8953 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:41.367287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07092d5f-c308-4336-a072-c7094c1c8953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:41.368698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07092d5f-c308-4336-a072-c7094c1c8953 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:41.380341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 506/1001] 10.222.0.74 () {56 vars in 1087 bytes} [Mon May 23 16:27:41 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:41.501947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a39fa6-2f3f-45b7-b833-6d54f6ef27e0 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:41.502476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a39fa6-2f3f-45b7-b833-6d54f6ef27e0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:41.502609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a39fa6-2f3f-45b7-b833-6d54f6ef27e0 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:41.504234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 496/1002] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:41.510018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61e139-2a6f-4b7d-bd6a-b0c239f4b358 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:41.510303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61e139-2a6f-4b7d-bd6a-b0c239f4b358 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:41.510576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61e139-2a6f-4b7d-bd6a-b0c239f4b358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:41.528366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4f61e139-2a6f-4b7d-bd6a-b0c239f4b358 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:41.529568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4f61e139-2a6f-4b7d-bd6a-b0c239f4b358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:41.603942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 507/1003] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:41.626733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a39fa6-2f3f-45b7-b833-6d54f6ef27e0 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:41.711007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:41.731132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a39fa6-2f3f-45b7-b833-6d54f6ef27e0 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:41.766547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87a0d4-53b4-433d-acba-b8f25edcb9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:41.767452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a0d4-53b4-433d-acba-b8f25edcb9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:41.767733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a0d4-53b4-433d-acba-b8f25edcb9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:41.768063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a0d4-53b4-433d-acba-b8f25edcb9c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:41.768751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87a0d4-53b4-433d-acba-b8f25edcb9c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:41.770119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87a0d4-53b4-433d-acba-b8f25edcb9c1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-6d87a0d4-53b4-433d-acba-b8f25edcb9c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:41.782345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:41.783351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 16:27:41.785071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:41.788380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 497/1004] 10.222.0.74 () {56 vars in 1126 bytes} [Mon May 23 16:27:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:41.790100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61e139-2a6f-4b7d-bd6a-b0c239f4b358 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:41.867455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:41.890830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61e139-2a6f-4b7d-bd6a-b0c239f4b358 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:41.925600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bcc14-3721-4eb8-8781-172dce922f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:41.926263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bcc14-3721-4eb8-8781-172dce922f48 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:41.926544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bcc14-3721-4eb8-8781-172dce922f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:41.926817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bcc14-3721-4eb8-8781-172dce922f48 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:41.927514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bcc14-3721-4eb8-8781-172dce922f48 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:41.927817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bcc14-3721-4eb8-8781-172dce922f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:41.929217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bcc14-3721-4eb8-8781-172dce922f48 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:41.934174 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 508/1005] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:41.939569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87a0d4-53b4-433d-acba-b8f25edcb9c1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:42.040594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87a0d4-53b4-433d-acba-b8f25edcb9c1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:42.075520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee54d31-7e9f-45cd-b4fc-cc8558fc18a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:42.076191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee54d31-7e9f-45cd-b4fc-cc8558fc18a9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:42.076505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee54d31-7e9f-45cd-b4fc-cc8558fc18a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:42.076787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee54d31-7e9f-45cd-b4fc-cc8558fc18a9 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:42.077487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee54d31-7e9f-45cd-b4fc-cc8558fc18a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:42.077791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee54d31-7e9f-45cd-b4fc-cc8558fc18a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:42.079153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee54d31-7e9f-45cd-b4fc-cc8558fc18a9 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:42.089266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 498/1006] 10.222.0.74 () {56 vars in 1122 bytes} [Mon May 23 16:27:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:42.090840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bcc14-3721-4eb8-8781-172dce922f48 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:42.195670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bcc14-3721-4eb8-8781-172dce922f48 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:42.234515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842906d-186e-45fa-8fa6-6b7c879e95b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:42.235180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842906d-186e-45fa-8fa6-6b7c879e95b2 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:42.235460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842906d-186e-45fa-8fa6-6b7c879e95b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:42.235733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842906d-186e-45fa-8fa6-6b7c879e95b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:42.236533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842906d-186e-45fa-8fa6-6b7c879e95b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:42.238098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842906d-186e-45fa-8fa6-6b7c879e95b2 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:42.324820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:42.336321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 509/1007] 10.222.0.74 () {60 vars in 1144 bytes} [Mon May 23 16:27:42 2022] POST /identity/v3/endpoints => generated 325 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:43.164703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4cb7-e361-4e66-9684-77f194da32f6 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:43.165284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4cb7-e361-4e66-9684-77f194da32f6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:43.165284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4cb7-e361-4e66-9684-77f194da32f6 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:43.166752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 499/1008] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:43.171789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e855f85-1636-49d2-a809-d4a3eb7afd46 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:43.172080 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e855f85-1636-49d2-a809-d4a3eb7afd46 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:43.172392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e855f85-1636-49d2-a809-d4a3eb7afd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:43.190258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6e855f85-1636-49d2-a809-d4a3eb7afd46 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:43.191582 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6e855f85-1636-49d2-a809-d4a3eb7afd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:43.269005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 510/1009] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:43.290701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f4cb7-e361-4e66-9684-77f194da32f6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:43.303057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:43.393485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f4cb7-e361-4e66-9684-77f194da32f6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:43.431362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccfd30-9f68-4683-8613-dd2b66854f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:43.431954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfd30-9f68-4683-8613-dd2b66854f28 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:43.432235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfd30-9f68-4683-8613-dd2b66854f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:43.432544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfd30-9f68-4683-8613-dd2b66854f28 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:43.433288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccfd30-9f68-4683-8613-dd2b66854f28 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:43.434686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccfd30-9f68-4683-8613-dd2b66854f28 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:43.529982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 500/1010] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:27:43 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:43.606264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b685b95-c53c-4f7b-b111-932a1071bd0d None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:43.606811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b685b95-c53c-4f7b-b111-932a1071bd0d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:43.606811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b685b95-c53c-4f7b-b111-932a1071bd0d None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:43.608484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 511/1011] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:43.614588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87956b-07a6-48ae-9327-741b4af10aba None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:43.614880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87956b-07a6-48ae-9327-741b4af10aba None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:43.615164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87956b-07a6-48ae-9327-741b4af10aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:43.633355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-ae87956b-07a6-48ae-9327-741b4af10aba None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:43.634597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ae87956b-07a6-48ae-9327-741b4af10aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:43.706529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:43.720340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 501/1012] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:43 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:43.741103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b685b95-c53c-4f7b-b111-932a1071bd0d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:43.849409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b685b95-c53c-4f7b-b111-932a1071bd0d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:43.876238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:43.885503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5c48f-2a94-48d8-b042-76a3ea97ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:43.886329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5c48f-2a94-48d8-b042-76a3ea97ab0e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:43.886616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5c48f-2a94-48d8-b042-76a3ea97ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:43.886893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5c48f-2a94-48d8-b042-76a3ea97ab0e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:43.887550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5c48f-2a94-48d8-b042-76a3ea97ab0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:43.889791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5c48f-2a94-48d8-b042-76a3ea97ab0e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-a8c5c48f-2a94-48d8-b042-76a3ea97ab0e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:43.901858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:43.902893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:43.903743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 512/1013] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:43.911112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87956b-07a6-48ae-9327-741b4af10aba None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:44.009718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87956b-07a6-48ae-9327-741b4af10aba None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:44.047672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bf12-1a37-4ca9-a694-18e2d14901ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:44.048370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bf12-1a37-4ca9-a694-18e2d14901ec None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:44.048658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bf12-1a37-4ca9-a694-18e2d14901ec None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:44.048954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bf12-1a37-4ca9-a694-18e2d14901ec None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:44.049651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16bf12-1a37-4ca9-a694-18e2d14901ec None admin] RBAC: Adding query filter params (name=compute) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:44.049950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16bf12-1a37-4ca9-a694-18e2d14901ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:44.051327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16bf12-1a37-4ca9-a694-18e2d14901ec None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:44.056607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 502/1014] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:44.061786 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5c48f-2a94-48d8-b042-76a3ea97ab0e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:44.164621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5c48f-2a94-48d8-b042-76a3ea97ab0e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:44.202580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515f5db-a8be-49a3-85f2-fb15837ac169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:44.203245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515f5db-a8be-49a3-85f2-fb15837ac169 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:44.203523 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515f5db-a8be-49a3-85f2-fb15837ac169 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:44.203795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515f5db-a8be-49a3-85f2-fb15837ac169 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:44.204524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515f5db-a8be-49a3-85f2-fb15837ac169 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:44.204826 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515f5db-a8be-49a3-85f2-fb15837ac169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:44.206737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515f5db-a8be-49a3-85f2-fb15837ac169 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:44.216429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 513/1015] 10.222.0.74 () {56 vars in 1112 bytes} [Mon May 23 16:27:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:44.217860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bf12-1a37-4ca9-a694-18e2d14901ec None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:44.278486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:44.321638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bf12-1a37-4ca9-a694-18e2d14901ec None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:44.355943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e39a8-2ef2-43da-a56c-feaa9462956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:44.356639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e39a8-2ef2-43da-a56c-feaa9462956b None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:44.356922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e39a8-2ef2-43da-a56c-feaa9462956b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:44.357195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e39a8-2ef2-43da-a56c-feaa9462956b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:44.357936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e39a8-2ef2-43da-a56c-feaa9462956b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:44.359331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e39a8-2ef2-43da-a56c-feaa9462956b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:44.444327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 503/1016] 10.222.0.74 () {60 vars in 1144 bytes} [Mon May 23 16:27:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:44.567686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bc19-ca19-4774-998e-c2f84161fa5a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:44.567884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bc19-ca19-4774-998e-c2f84161fa5a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:44.568169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bc19-ca19-4774-998e-c2f84161fa5a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:44.569747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 514/1017] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:27:44.575436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d34f-c689-41fd-af50-e672da7469af None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:44.575736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d34f-c689-41fd-af50-e672da7469af None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:44.576018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d34f-c689-41fd-af50-e672da7469af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:44.594242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7395d34f-c689-41fd-af50-e672da7469af None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:44.595487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7395d34f-c689-41fd-af50-e672da7469af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:44.688121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 504/1018] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:44.713623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bc19-ca19-4774-998e-c2f84161fa5a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:44.779487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:44.826329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bc19-ca19-4774-998e-c2f84161fa5a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:44.861251 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408abf8-6935-4bd5-ab03-fd4c1b4c852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:44.862631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408abf8-6935-4bd5-ab03-fd4c1b4c852d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:44.862853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408abf8-6935-4bd5-ab03-fd4c1b4c852d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:44.863101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408abf8-6935-4bd5-ab03-fd4c1b4c852d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:44.864289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408abf8-6935-4bd5-ab03-fd4c1b4c852d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:44.865753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408abf8-6935-4bd5-ab03-fd4c1b4c852d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:44.867528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 515/1019] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:44.873183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395d34f-c689-41fd-af50-e672da7469af None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:44.915882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:44.974517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395d34f-c689-41fd-af50-e672da7469af None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:45.009390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd93eab-388b-4891-9033-2e2c0527279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:45.010056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd93eab-388b-4891-9033-2e2c0527279d None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:45.010339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd93eab-388b-4891-9033-2e2c0527279d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:45.010613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd93eab-388b-4891-9033-2e2c0527279d None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:45.011324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd93eab-388b-4891-9033-2e2c0527279d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:45.012792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd93eab-388b-4891-9033-2e2c0527279d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:45.119283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 505/1020] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:27:44 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:45.798253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4589d-d6b5-4f67-88ea-6973d59d955a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:45.798792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4589d-d6b5-4f67-88ea-6973d59d955a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:45.798792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4589d-d6b5-4f67-88ea-6973d59d955a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:45.800344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 516/1021] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:45.805693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ba36-2a12-4aa0-99c2-fa1ad846031b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:45.806128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ba36-2a12-4aa0-99c2-fa1ad846031b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:45.806296 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ba36-2a12-4aa0-99c2-fa1ad846031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:45.822893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8b31ba36-2a12-4aa0-99c2-fa1ad846031b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:45.824073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8b31ba36-2a12-4aa0-99c2-fa1ad846031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:45.892290 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 506/1022] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:45.914876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4589d-d6b5-4f67-88ea-6973d59d955a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:46.015170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4589d-d6b5-4f67-88ea-6973d59d955a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:46.037797 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:46.053701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a1d5-8a5f-48be-a3a7-8dd747e36f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:46.053701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a1d5-8a5f-48be-a3a7-8dd747e36f6d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:46.053701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a1d5-8a5f-48be-a3a7-8dd747e36f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:46.053701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a1d5-8a5f-48be-a3a7-8dd747e36f6d None admin] PATH_INFO: `/v3/services/image` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:46.054085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534a1d5-8a5f-48be-a3a7-8dd747e36f6d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:46.054085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534a1d5-8a5f-48be-a3a7-8dd747e36f6d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-1534a1d5-8a5f-48be-a3a7-8dd747e36f6d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:46.065990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:46.066983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:27:46.067873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:46.069427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 517/1023] 10.222.0.74 () {56 vars in 1105 bytes} [Mon May 23 16:27:45 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:46.073629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ba36-2a12-4aa0-99c2-fa1ad846031b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:46.097697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:46.173123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ba36-2a12-4aa0-99c2-fa1ad846031b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:46.210791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87242e1a-c5f8-46b4-a833-7f7c2d3f42fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:46.211458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87242e1a-c5f8-46b4-a833-7f7c2d3f42fe None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:46.214667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87242e1a-c5f8-46b4-a833-7f7c2d3f42fe None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:46.214667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87242e1a-c5f8-46b4-a833-7f7c2d3f42fe None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:46.214667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87242e1a-c5f8-46b4-a833-7f7c2d3f42fe None admin] RBAC: Adding query filter params (name=image) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:46.214667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87242e1a-c5f8-46b4-a833-7f7c2d3f42fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:46.214667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87242e1a-c5f8-46b4-a833-7f7c2d3f42fe None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:46.225976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 507/1024] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:46.227669 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a1d5-8a5f-48be-a3a7-8dd747e36f6d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:46.334027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a1d5-8a5f-48be-a3a7-8dd747e36f6d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:46.367903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03225dea-80e1-4b33-bcb4-23ca0e3b2f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:46.368615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03225dea-80e1-4b33-bcb4-23ca0e3b2f18 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:46.368900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03225dea-80e1-4b33-bcb4-23ca0e3b2f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:46.369175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03225dea-80e1-4b33-bcb4-23ca0e3b2f18 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:46.369883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03225dea-80e1-4b33-bcb4-23ca0e3b2f18 None admin] RBAC: Adding query filter params (type=image) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:46.370189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03225dea-80e1-4b33-bcb4-23ca0e3b2f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:46.371557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03225dea-80e1-4b33-bcb4-23ca0e3b2f18 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:46.382052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 518/1025] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:46.383621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87242e1a-c5f8-46b4-a833-7f7c2d3f42fe None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:46.470027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:46.485542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87242e1a-c5f8-46b4-a833-7f7c2d3f42fe None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:46.520725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428115b-a111-47d5-bdbe-ef3513cc2b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:46.521383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428115b-a111-47d5-bdbe-ef3513cc2b77 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:46.521666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428115b-a111-47d5-bdbe-ef3513cc2b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:46.521938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428115b-a111-47d5-bdbe-ef3513cc2b77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:46.522725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428115b-a111-47d5-bdbe-ef3513cc2b77 None admin] RBAC: Adding query filter params (interface=public, service_id=dcaf17d6a7bb45d287448e3703bd15ff, region_id=RegionOne) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:46.523035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428115b-a111-47d5-bdbe-ef3513cc2b77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:46.524436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428115b-a111-47d5-bdbe-ef3513cc2b77 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:46.534700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 508/1026] 10.222.0.74 () {56 vars in 1251 bytes} [Mon May 23 16:27:46 2022] GET /identity/v3/endpoints?service_id=dcaf17d6a7bb45d287448e3703bd15ff&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:46.536324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03225dea-80e1-4b33-bcb4-23ca0e3b2f18 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:46.587049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:46.640839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03225dea-80e1-4b33-bcb4-23ca0e3b2f18 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:46.678535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942f97-fadd-44e1-ab54-ac71d4359064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:46.679209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942f97-fadd-44e1-ab54-ac71d4359064 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:46.679494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942f97-fadd-44e1-ab54-ac71d4359064 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:46.679767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942f97-fadd-44e1-ab54-ac71d4359064 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:46.680475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb942f97-fadd-44e1-ab54-ac71d4359064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:46.681847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb942f97-fadd-44e1-ab54-ac71d4359064 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:46.696381 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 519/1027] 10.222.0.74 () {56 vars in 1087 bytes} [Mon May 23 16:27:46 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:46.828007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc95a-f784-46b7-b6ab-da7b0b36a440 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:46.828557 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc95a-f784-46b7-b6ab-da7b0b36a440 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:46.828636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc95a-f784-46b7-b6ab-da7b0b36a440 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:46.830352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 509/1028] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:46.836058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccebc8d-5fa0-4f21-a746-2211da10d7c2 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:46.836590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccebc8d-5fa0-4f21-a746-2211da10d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:46.836678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccebc8d-5fa0-4f21-a746-2211da10d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:46.855711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-5ccebc8d-5fa0-4f21-a746-2211da10d7c2 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:46.856969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5ccebc8d-5fa0-4f21-a746-2211da10d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:46.930253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 520/1029] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:46.954025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc95a-f784-46b7-b6ab-da7b0b36a440 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:47.060455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc95a-f784-46b7-b6ab-da7b0b36a440 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:47.097390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467bca3-e52a-4fb4-ae3c-c2b87e06d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:47.098208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467bca3-e52a-4fb4-ae3c-c2b87e06d14a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:47.098491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467bca3-e52a-4fb4-ae3c-c2b87e06d14a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:47.098763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467bca3-e52a-4fb4-ae3c-c2b87e06d14a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:47.108930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467bca3-e52a-4fb4-ae3c-c2b87e06d14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-d467bca3-e52a-4fb4-ae3c-c2b87e06d14a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:47.117902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:47.118879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:47.119816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:47.127866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 510/1030] 10.222.0.74 () {56 vars in 1120 bytes} [Mon May 23 16:27:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:47.128019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccebc8d-5fa0-4f21-a746-2211da10d7c2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:47.173093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:47.241650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccebc8d-5fa0-4f21-a746-2211da10d7c2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:47.277210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eaac3-c24c-40ea-863b-f797ec6da43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:47.277885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eaac3-c24c-40ea-863b-f797ec6da43c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:47.278168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eaac3-c24c-40ea-863b-f797ec6da43c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:47.278441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eaac3-c24c-40ea-863b-f797ec6da43c None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:47.279185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020eaac3-c24c-40ea-863b-f797ec6da43c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:47.279490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020eaac3-c24c-40ea-863b-f797ec6da43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:47.280897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020eaac3-c24c-40ea-863b-f797ec6da43c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:47.289729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 521/1031] 10.222.0.74 () {56 vars in 1115 bytes} [Mon May 23 16:27:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:47.295248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467bca3-e52a-4fb4-ae3c-c2b87e06d14a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:47.308822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:47.379173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62266-7426-4534-807c-f2c4b39cfc91 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:47.379475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62266-7426-4534-807c-f2c4b39cfc91 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:47.379663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62266-7426-4534-807c-f2c4b39cfc91 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:47.384337 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 522/1032] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:27:47.386212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e266d-14e6-4b8c-a0bd-d18cad2df918 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:47.386500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e266d-14e6-4b8c-a0bd-d18cad2df918 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:47.386778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e266d-14e6-4b8c-a0bd-d18cad2df918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:47.407870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-470e266d-14e6-4b8c-a0bd-d18cad2df918 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:47.410055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-470e266d-14e6-4b8c-a0bd-d18cad2df918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:47.428838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467bca3-e52a-4fb4-ae3c-c2b87e06d14a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:47.476688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652de99f-4778-4d5f-a175-993679a46a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:47.477499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652de99f-4778-4d5f-a175-993679a46a02 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:47.477785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652de99f-4778-4d5f-a175-993679a46a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:47.478065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652de99f-4778-4d5f-a175-993679a46a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:47.493149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652de99f-4778-4d5f-a175-993679a46a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:47.494626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652de99f-4778-4d5f-a175-993679a46a02 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-652de99f-4778-4d5f-a175-993679a46a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:47.516270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:47.517482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:47.518929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:47.518929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:47.518929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:47.518929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:47.519153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 523/1033] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:47.526008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 511/1034] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:47.527586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e266d-14e6-4b8c-a0bd-d18cad2df918 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:47.538819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652de99f-4778-4d5f-a175-993679a46a02 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:47.572267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:47.618679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:47.662831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e266d-14e6-4b8c-a0bd-d18cad2df918 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:47.666851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652de99f-4778-4d5f-a175-993679a46a02 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:47.709416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bac3a7-0b7f-4d2b-8252-ae9969bd4805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:47.710893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bac3a7-0b7f-4d2b-8252-ae9969bd4805 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:47.710893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bac3a7-0b7f-4d2b-8252-ae9969bd4805 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:47.710893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bac3a7-0b7f-4d2b-8252-ae9969bd4805 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:47.712490 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bac3a7-0b7f-4d2b-8252-ae9969bd4805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:47.714027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bac3a7-0b7f-4d2b-8252-ae9969bd4805 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:47.714702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeffe5d-e5dc-4f00-a1a5-00540b785340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:47.716208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeffe5d-e5dc-4f00-a1a5-00540b785340 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:47.720331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeffe5d-e5dc-4f00-a1a5-00540b785340 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:47.720471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 512/1035] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:47.721206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeffe5d-e5dc-4f00-a1a5-00540b785340 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:47.721206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeffe5d-e5dc-4f00-a1a5-00540b785340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:47.721206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeffe5d-e5dc-4f00-a1a5-00540b785340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:47.721206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeffe5d-e5dc-4f00-a1a5-00540b785340 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:47.722739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bac3a7-0b7f-4d2b-8252-ae9969bd4805 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:47.742846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 524/1036] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:47.744653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeffe5d-e5dc-4f00-a1a5-00540b785340 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:47.836329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bac3a7-0b7f-4d2b-8252-ae9969bd4805 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:47.849234 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:47.855183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeffe5d-e5dc-4f00-a1a5-00540b785340 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:47.871544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:47.880418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c245d0-5a91-4383-a6bc-61940ec95a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:47.881099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c245d0-5a91-4383-a6bc-61940ec95a29 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:47.881384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c245d0-5a91-4383-a6bc-61940ec95a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:47.881658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c245d0-5a91-4383-a6bc-61940ec95a29 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:47.882464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c245d0-5a91-4383-a6bc-61940ec95a29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:47.883905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c245d0-5a91-4383-a6bc-61940ec95a29 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:47.891302 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7214f-01dc-43ca-aea9-34564d1cd818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:47.893086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7214f-01dc-43ca-aea9-34564d1cd818 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:47.893673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7214f-01dc-43ca-aea9-34564d1cd818 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:47.894113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7214f-01dc-43ca-aea9-34564d1cd818 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:47.901894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7214f-01dc-43ca-aea9-34564d1cd818 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:47.903340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7214f-01dc-43ca-aea9-34564d1cd818 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-94c7214f-01dc-43ca-aea9-34564d1cd818 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:47.918802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:47.919963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:47.921184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:47.924469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 525/1037] 10.222.0.74 () {56 vars in 1093 bytes} [Mon May 23 16:27:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:47.925954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7214f-01dc-43ca-aea9-34564d1cd818 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:48.012219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 513/1038] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:27:47 2022] POST /identity/v3/users => generated 285 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:27:48.029688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7214f-01dc-43ca-aea9-34564d1cd818 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:48.068060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c00741-1f3f-4026-9eb1-157299382e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:48.068790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c00741-1f3f-4026-9eb1-157299382e98 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:48.069070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c00741-1f3f-4026-9eb1-157299382e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:48.069340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c00741-1f3f-4026-9eb1-157299382e98 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:48.070198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c00741-1f3f-4026-9eb1-157299382e98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:48.070507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c00741-1f3f-4026-9eb1-157299382e98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:48.071979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c00741-1f3f-4026-9eb1-157299382e98 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:48.099627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 526/1039] 10.222.0.74 () {56 vars in 1133 bytes} [Mon May 23 16:27:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:48.101590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c245d0-5a91-4383-a6bc-61940ec95a29 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:48.212455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c245d0-5a91-4383-a6bc-61940ec95a29 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:48.247232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ca4c-86e8-4f25-a0bb-ea77ca693420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:48.247886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ca4c-86e8-4f25-a0bb-ea77ca693420 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:48.248168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ca4c-86e8-4f25-a0bb-ea77ca693420 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:48.248482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ca4c-86e8-4f25-a0bb-ea77ca693420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:48.309016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:48.322682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087ca4c-86e8-4f25-a0bb-ea77ca693420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:48.324276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087ca4c-86e8-4f25-a0bb-ea77ca693420 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:48.430134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 514/1040] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:48 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:27:48.431421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c00741-1f3f-4026-9eb1-157299382e98 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:48.448467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:48.535488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c00741-1f3f-4026-9eb1-157299382e98 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:48.572074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1112e3-ab47-4f2d-af96-eefa87cb4a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:48.573256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1112e3-ab47-4f2d-af96-eefa87cb4a29 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:48.573923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1112e3-ab47-4f2d-af96-eefa87cb4a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:48.574399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1112e3-ab47-4f2d-af96-eefa87cb4a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:48.584785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1112e3-ab47-4f2d-af96-eefa87cb4a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:48.586508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1112e3-ab47-4f2d-af96-eefa87cb4a29 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-db1112e3-ab47-4f2d-af96-eefa87cb4a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:48.604237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:48.605195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:48.606633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:48.606633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:48.606633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:48.606633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:48.608689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 527/1041] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:48.614495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ca4c-86e8-4f25-a0bb-ea77ca693420 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:48.701844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:48.716228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ca4c-86e8-4f25-a0bb-ea77ca693420 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:48.751551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8dd67-39a2-4ea8-aad4-664ee02670b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:48.752948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8dd67-39a2-4ea8-aad4-664ee02670b5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:48.753219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8dd67-39a2-4ea8-aad4-664ee02670b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:48.753479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8dd67-39a2-4ea8-aad4-664ee02670b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:48.754227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8dd67-39a2-4ea8-aad4-664ee02670b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:48.754534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8dd67-39a2-4ea8-aad4-664ee02670b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:48.755966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8dd67-39a2-4ea8-aad4-664ee02670b5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:48.774127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 515/1042] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:48.776104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1112e3-ab47-4f2d-af96-eefa87cb4a29 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:48.845042 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:48.881461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1112e3-ab47-4f2d-af96-eefa87cb4a29 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:48.917885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254b85-79da-4631-8832-ac0f93b88ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:48.918734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254b85-79da-4631-8832-ac0f93b88ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:48.919021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254b85-79da-4631-8832-ac0f93b88ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:48.919298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254b85-79da-4631-8832-ac0f93b88ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:48.926023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254b85-79da-4631-8832-ac0f93b88ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:48.927532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254b85-79da-4631-8832-ac0f93b88ee3 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-99254b85-79da-4631-8832-ac0f93b88ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:48.941945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:48.942843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:48.943750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:48.943750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:48.943750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:48.943750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:48.943750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:48.943750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:48.943750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:48.943750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:48.947886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5a57f-a48a-4571-b03b-e74e633739f5 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:48.948447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 528/1043] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:48.948537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5a57f-a48a-4571-b03b-e74e633739f5 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:48.948755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5a57f-a48a-4571-b03b-e74e633739f5 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:48.949102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254b85-79da-4631-8832-ac0f93b88ee3 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:48.950155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 516/1044] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:48.956528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689517-4eed-45d0-9d39-7e82cc10df7b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:48.956821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689517-4eed-45d0-9d39-7e82cc10df7b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:48.957101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689517-4eed-45d0-9d39-7e82cc10df7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:48.973915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-e6689517-4eed-45d0-9d39-7e82cc10df7b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:48.975192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e6689517-4eed-45d0-9d39-7e82cc10df7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:49.049524 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 517/1045] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:49.057416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254b85-79da-4631-8832-ac0f93b88ee3 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:49.073038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689517-4eed-45d0-9d39-7e82cc10df7b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:49.084571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:49.093964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17f913-d56e-41db-b1e7-353c83d7481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:49.094748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17f913-d56e-41db-b1e7-353c83d7481a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:49.097438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17f913-d56e-41db-b1e7-353c83d7481a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:49.097438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17f913-d56e-41db-b1e7-353c83d7481a None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:49.097438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17f913-d56e-41db-b1e7-353c83d7481a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:49.097438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17f913-d56e-41db-b1e7-353c83d7481a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:49.100067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17f913-d56e-41db-b1e7-353c83d7481a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:49.113778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 529/1046] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:49.121673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17f913-d56e-41db-b1e7-353c83d7481a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:49.160416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:49.188907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689517-4eed-45d0-9d39-7e82cc10df7b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:49.229598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d175a-1d81-41d4-866c-6f15afe00c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:49.230393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d175a-1d81-41d4-866c-6f15afe00c61 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:49.230673 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d175a-1d81-41d4-866c-6f15afe00c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:49.230956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d175a-1d81-41d4-866c-6f15afe00c61 None admin] PATH_INFO: `/v3/services/image` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:49.231610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d175a-1d81-41d4-866c-6f15afe00c61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:49.233009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d175a-1d81-41d4-866c-6f15afe00c61 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:49.237808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17f913-d56e-41db-b1e7-353c83d7481a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-9b8d175a-1d81-41d4-866c-6f15afe00c61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:49.244681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:49.245675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:49.246540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 518/1047] 10.222.0.74 () {56 vars in 1105 bytes} [Mon May 23 16:27:49 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:49.252406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d175a-1d81-41d4-866c-6f15afe00c61 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:49.282014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f02195-9e1c-4275-919f-dfdf9b5a8a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:49.282997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f02195-9e1c-4275-919f-dfdf9b5a8a04 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:49.283758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f02195-9e1c-4275-919f-dfdf9b5a8a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:49.283758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f02195-9e1c-4275-919f-dfdf9b5a8a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:49.284894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f02195-9e1c-4275-919f-dfdf9b5a8a04 None admin] RBAC: Adding query filter params (role.id=20e7b7e974a34b60917b112f4314ba18, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=951eca3289634609bcb684181e147ca3) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:49.285217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f02195-9e1c-4275-919f-dfdf9b5a8a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:49.286924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f02195-9e1c-4275-919f-dfdf9b5a8a04 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:49.292940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 530/1048] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:49 2022] GET /identity/v3/role_assignments?user.id=951eca3289634609bcb684181e147ca3&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=20e7b7e974a34b60917b112f4314ba18 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:49.375998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d175a-1d81-41d4-866c-6f15afe00c61 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:49.416118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48412d2-30cd-4c0d-976d-6b89a69e8297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:49.417107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48412d2-30cd-4c0d-976d-6b89a69e8297 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:49.417545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48412d2-30cd-4c0d-976d-6b89a69e8297 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:49.417973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48412d2-30cd-4c0d-976d-6b89a69e8297 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:49.418849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48412d2-30cd-4c0d-976d-6b89a69e8297 None admin] RBAC: Adding query filter params (name=image) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:49.419310 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48412d2-30cd-4c0d-976d-6b89a69e8297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:49.420925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48412d2-30cd-4c0d-976d-6b89a69e8297 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:49.428170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 519/1049] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:49.433836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f02195-9e1c-4275-919f-dfdf9b5a8a04 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:49.490941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:49.542109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f02195-9e1c-4275-919f-dfdf9b5a8a04 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:49.575490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370f10a-ec49-4320-8c24-f7be1947bbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:49.576187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f10a-ec49-4320-8c24-f7be1947bbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:49.576496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f10a-ec49-4320-8c24-f7be1947bbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:49.576775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f10a-ec49-4320-8c24-f7be1947bbc6 None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:49.577479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370f10a-ec49-4320-8c24-f7be1947bbc6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:49.577785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370f10a-ec49-4320-8c24-f7be1947bbc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:49.579155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370f10a-ec49-4320-8c24-f7be1947bbc6 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:49.588338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 531/1050] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:49.590200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48412d2-30cd-4c0d-976d-6b89a69e8297 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:49.594913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:49.694400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48412d2-30cd-4c0d-976d-6b89a69e8297 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:49.729186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dd833-480e-431c-9af4-311e719cecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:49.729844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dd833-480e-431c-9af4-311e719cecb5 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:49.730124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dd833-480e-431c-9af4-311e719cecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:49.730397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dd833-480e-431c-9af4-311e719cecb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:49.731127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098dd833-480e-431c-9af4-311e719cecb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:49.732547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098dd833-480e-431c-9af4-311e719cecb5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:49.852962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 520/1051] 10.222.0.74 () {60 vars in 1144 bytes} [Mon May 23 16:27:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:50.303724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6c78-3b65-4f97-a626-8c890189ee1b None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:50.304239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6c78-3b65-4f97-a626-8c890189ee1b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:50.304375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6c78-3b65-4f97-a626-8c890189ee1b None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:50.305703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 532/1052] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:50.310870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488236c-fd07-4630-bf36-2416425ba2ff None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:50.311257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488236c-fd07-4630-bf36-2416425ba2ff None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:50.311475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488236c-fd07-4630-bf36-2416425ba2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:50.328384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d488236c-fd07-4630-bf36-2416425ba2ff None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:50.329581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d488236c-fd07-4630-bf36-2416425ba2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:50.389120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:50.408639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 521/1053] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:50.432529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e6c78-3b65-4f97-a626-8c890189ee1b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:50.536254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e6c78-3b65-4f97-a626-8c890189ee1b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:50.551293 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:50.571603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535e47c-1c8a-4d92-b674-0ba43bf6bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:50.572434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535e47c-1c8a-4d92-b674-0ba43bf6bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:50.572717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535e47c-1c8a-4d92-b674-0ba43bf6bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:50.572993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535e47c-1c8a-4d92-b674-0ba43bf6bbc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:50.584034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535e47c-1c8a-4d92-b674-0ba43bf6bbc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-a535e47c-1c8a-4d92-b674-0ba43bf6bbc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:50.591549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:50.592559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:50.593450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 533/1054] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:50.600820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488236c-fd07-4630-bf36-2416425ba2ff None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:50.700140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488236c-fd07-4630-bf36-2416425ba2ff None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:50.734278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df64487-9905-4fc9-af02-e9fcd9df394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:50.734948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df64487-9905-4fc9-af02-e9fcd9df394d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:50.735230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df64487-9905-4fc9-af02-e9fcd9df394d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:50.735505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df64487-9905-4fc9-af02-e9fcd9df394d None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:50.736817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df64487-9905-4fc9-af02-e9fcd9df394d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:50.737123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df64487-9905-4fc9-af02-e9fcd9df394d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:50.738496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df64487-9905-4fc9-af02-e9fcd9df394d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:50.751312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 522/1055] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:50.752550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535e47c-1c8a-4d92-b674-0ba43bf6bbc4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:50.853194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535e47c-1c8a-4d92-b674-0ba43bf6bbc4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:50.886631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe88879-b27a-4994-85f0-0a28b1254944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:50.887551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe88879-b27a-4994-85f0-0a28b1254944 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:50.887835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe88879-b27a-4994-85f0-0a28b1254944 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:50.888109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe88879-b27a-4994-85f0-0a28b1254944 None admin] PATH_INFO: `/v3/users/968a196d7bbd4ad39c8cb9b8f3a1e17e` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:50.901619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe88879-b27a-4994-85f0-0a28b1254944 None admin] RBAC: Authorizing `identity:get_user(user_id=968a196d7bbd4ad39c8cb9b8f3a1e17e)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:50.903067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe88879-b27a-4994-85f0-0a28b1254944 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:50.909701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 534/1056] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:27:50 2022] GET /identity/v3/users/968a196d7bbd4ad39c8cb9b8f3a1e17e => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:50.910674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df64487-9905-4fc9-af02-e9fcd9df394d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:50.960162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:51.015437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df64487-9905-4fc9-af02-e9fcd9df394d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:51.051420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78c12-5030-44bb-9a4d-6188dd04e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:51.052069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78c12-5030-44bb-9a4d-6188dd04e1bf None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:51.052384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78c12-5030-44bb-9a4d-6188dd04e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:51.052667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78c12-5030-44bb-9a4d-6188dd04e1bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:51.126314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c78c12-5030-44bb-9a4d-6188dd04e1bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:51.127836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c78c12-5030-44bb-9a4d-6188dd04e1bf None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:51.177790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:51.239115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 523/1057] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:27:51.240516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe88879-b27a-4994-85f0-0a28b1254944 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:51.273767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:51.349775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe88879-b27a-4994-85f0-0a28b1254944 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:51.385187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efcad6-9489-45c6-8725-48c0b708eb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:51.385974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efcad6-9489-45c6-8725-48c0b708eb1e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:51.386259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efcad6-9489-45c6-8725-48c0b708eb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:51.386536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efcad6-9489-45c6-8725-48c0b708eb1e None admin] PATH_INFO: `/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:51.387711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efcad6-9489-45c6-8725-48c0b708eb1e None admin] RBAC: Authorizing `identity:get_project(project_id=4e5d0b971f4d4fbda8513172bf49f5ed)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:51.389447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efcad6-9489-45c6-8725-48c0b708eb1e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:51.391311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 535/1058] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:27:51 2022] GET /identity/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:51.398028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78c12-5030-44bb-9a4d-6188dd04e1bf None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:51.500683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78c12-5030-44bb-9a4d-6188dd04e1bf None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:51.519531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702d27f-8480-4a87-b74e-d657d2edd449 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:51.519817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702d27f-8480-4a87-b74e-d657d2edd449 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:51.520096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702d27f-8480-4a87-b74e-d657d2edd449 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:51.521803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 536/1059] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:27:51.526835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd46df-4bc5-49ca-bf0a-f3571badd1e8 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:51.527120 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd46df-4bc5-49ca-bf0a-f3571badd1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:51.527395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd46df-4bc5-49ca-bf0a-f3571badd1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:51.538007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb97792-4674-4c0a-a1c5-32c7fb27ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:51.539083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb97792-4674-4c0a-a1c5-32c7fb27ced8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:51.539375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb97792-4674-4c0a-a1c5-32c7fb27ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:51.539650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb97792-4674-4c0a-a1c5-32c7fb27ced8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:51.540523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb97792-4674-4c0a-a1c5-32c7fb27ced8 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=4e5d0b971f4d4fbda8513172bf49f5ed, user.id=968a196d7bbd4ad39c8cb9b8f3a1e17e) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:51.540840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb97792-4674-4c0a-a1c5-32c7fb27ced8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:51.542268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb97792-4674-4c0a-a1c5-32c7fb27ced8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:51.544482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-40dd46df-4bc5-49ca-bf0a-f3571badd1e8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:51.545665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-40dd46df-4bc5-49ca-bf0a-f3571badd1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:51.548217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 524/1060] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:51 2022] GET /identity/v3/role_assignments?user.id=968a196d7bbd4ad39c8cb9b8f3a1e17e&scope.project.id=4e5d0b971f4d4fbda8513172bf49f5ed&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:51.623227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 537/1061] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:51.647525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb97792-4674-4c0a-a1c5-32c7fb27ced8 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:51.665825 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:51.760895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb97792-4674-4c0a-a1c5-32c7fb27ced8 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:51.797417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850978-aa0e-45ce-9f89-c2f30fd072a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:51.798234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850978-aa0e-45ce-9f89-c2f30fd072a1 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:51.799161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850978-aa0e-45ce-9f89-c2f30fd072a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:51.799450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850978-aa0e-45ce-9f89-c2f30fd072a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:51.809688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850978-aa0e-45ce-9f89-c2f30fd072a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-08850978-aa0e-45ce-9f89-c2f30fd072a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:51.818758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:51.819710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:51.820964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:51.824385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 525/1062] 10.222.0.74 () {56 vars in 1120 bytes} [Mon May 23 16:27:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:51.826206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd46df-4bc5-49ca-bf0a-f3571badd1e8 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:51.856915 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:51.928850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd46df-4bc5-49ca-bf0a-f3571badd1e8 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:51.965927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a455b-88ab-45fc-8b09-e0454e07f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:51.966627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a455b-88ab-45fc-8b09-e0454e07f015 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:51.966910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a455b-88ab-45fc-8b09-e0454e07f015 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:51.967184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a455b-88ab-45fc-8b09-e0454e07f015 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:51.967956 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a455b-88ab-45fc-8b09-e0454e07f015 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:51.968266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a455b-88ab-45fc-8b09-e0454e07f015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:51.969720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a455b-88ab-45fc-8b09-e0454e07f015 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:51.984865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 538/1063] 10.222.0.74 () {56 vars in 1115 bytes} [Mon May 23 16:27:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:51.986906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850978-aa0e-45ce-9f89-c2f30fd072a1 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:52.062428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:52.092430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850978-aa0e-45ce-9f89-c2f30fd072a1 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:52.128874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb48e-d707-4fae-8ccb-c176cca7ca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:52.129680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb48e-d707-4fae-8ccb-c176cca7ca98 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.129966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb48e-d707-4fae-8ccb-c176cca7ca98 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.130243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb48e-d707-4fae-8ccb-c176cca7ca98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.141240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb48e-d707-4fae-8ccb-c176cca7ca98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:52.143254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb48e-d707-4fae-8ccb-c176cca7ca98 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:52.155401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17907a42-418e-41f5-b803-437996396b61 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.155688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17907a42-418e-41f5-b803-437996396b61 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.155967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17907a42-418e-41f5-b803-437996396b61 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.157512 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 539/1064] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-06cbb48e-d707-4fae-8ccb-c176cca7ca98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:52.160869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:52.162150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:52.163512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:52.163512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:52.163512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:52.163512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:52.163754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702262f-c954-4132-a493-d69b71f976cd None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.163754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702262f-c954-4132-a493-d69b71f976cd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.163754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702262f-c954-4132-a493-d69b71f976cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.164593 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 526/1065] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:52.167439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb48e-d707-4fae-8ccb-c176cca7ca98 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:52.181353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9702262f-c954-4132-a493-d69b71f976cd None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:52.182791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9702262f-c954-4132-a493-d69b71f976cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:52.257508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 540/1066] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:52.280126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702262f-c954-4132-a493-d69b71f976cd None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:52.285497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb48e-d707-4fae-8ccb-c176cca7ca98 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:52.309854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:52.310720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:52.322111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eedc4-5b78-4c60-b2b5-6882b6065f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:52.322874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eedc4-5b78-4c60-b2b5-6882b6065f65 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.323163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eedc4-5b78-4c60-b2b5-6882b6065f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.323442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eedc4-5b78-4c60-b2b5-6882b6065f65 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.324175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940eedc4-5b78-4c60-b2b5-6882b6065f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:52.324521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940eedc4-5b78-4c60-b2b5-6882b6065f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:52.325909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940eedc4-5b78-4c60-b2b5-6882b6065f65 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:52.340282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 527/1067] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:52.346703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eedc4-5b78-4c60-b2b5-6882b6065f65 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:52.400963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702262f-c954-4132-a493-d69b71f976cd None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:52.436471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f34ce-49fa-4dce-9021-0e2bcd1c3e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:52.437130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f34ce-49fa-4dce-9021-0e2bcd1c3e17 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.437419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f34ce-49fa-4dce-9021-0e2bcd1c3e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.437696 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f34ce-49fa-4dce-9021-0e2bcd1c3e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.454311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eedc4-5b78-4c60-b2b5-6882b6065f65 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:52.492933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd185e27-66a4-4d47-86c9-6abe1348e330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:52.493722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd185e27-66a4-4d47-86c9-6abe1348e330 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.494034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd185e27-66a4-4d47-86c9-6abe1348e330 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.494280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd185e27-66a4-4d47-86c9-6abe1348e330 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.502460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd185e27-66a4-4d47-86c9-6abe1348e330 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:52.503914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd185e27-66a4-4d47-86c9-6abe1348e330 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:52.511346 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f34ce-49fa-4dce-9021-0e2bcd1c3e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:52.513158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f34ce-49fa-4dce-9021-0e2bcd1c3e17 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-cd185e27-66a4-4d47-86c9-6abe1348e330 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:52.519031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:52.519973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:52.521176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 528/1068] 10.222.0.74 () {56 vars in 1093 bytes} [Mon May 23 16:27:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:52.525937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd185e27-66a4-4d47-86c9-6abe1348e330 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:52.541087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:52.573299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:52.631507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd185e27-66a4-4d47-86c9-6abe1348e330 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:52.636311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 541/1069] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:27:52.643335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f34ce-49fa-4dce-9021-0e2bcd1c3e17 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:52.674951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa859-4f37-461a-b66c-83cd27362983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:52.675628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa859-4f37-461a-b66c-83cd27362983 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.675914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa859-4f37-461a-b66c-83cd27362983 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.676193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa859-4f37-461a-b66c-83cd27362983 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.677063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aa859-4f37-461a-b66c-83cd27362983 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:52.677463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aa859-4f37-461a-b66c-83cd27362983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:52.678817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aa859-4f37-461a-b66c-83cd27362983 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:52.698791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 529/1070] 10.222.0.74 () {56 vars in 1133 bytes} [Mon May 23 16:27:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:52.704168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa859-4f37-461a-b66c-83cd27362983 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:52.754436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f34ce-49fa-4dce-9021-0e2bcd1c3e17 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:52.776978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:52.789501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce602a-7694-4142-bb82-2f0d61a002d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:52.790305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce602a-7694-4142-bb82-2f0d61a002d2 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.790587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce602a-7694-4142-bb82-2f0d61a002d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.790884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce602a-7694-4142-bb82-2f0d61a002d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.802467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce602a-7694-4142-bb82-2f0d61a002d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:52.803923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce602a-7694-4142-bb82-2f0d61a002d2 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:52.813253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa859-4f37-461a-b66c-83cd27362983 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:52.815187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-72ce602a-7694-4142-bb82-2f0d61a002d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:52.821649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:52.822540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:52.823479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:52.823479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:52.823479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:52.823479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:52.823479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 542/1071] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:52.828759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce602a-7694-4142-bb82-2f0d61a002d2 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:52.853997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52c469-bca7-4c26-9e90-d21891f3ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:52.854791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52c469-bca7-4c26-9e90-d21891f3ca52 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.855075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52c469-bca7-4c26-9e90-d21891f3ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.855349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52c469-bca7-4c26-9e90-d21891f3ca52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.866149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52c469-bca7-4c26-9e90-d21891f3ca52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:52.867620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52c469-bca7-4c26-9e90-d21891f3ca52 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-be52c469-bca7-4c26-9e90-d21891f3ca52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:52.885382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:52.886308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:52.893194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:52.893194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:52.893194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:52.893194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:52.893194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 530/1072] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:52.896535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52c469-bca7-4c26-9e90-d21891f3ca52 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:52.946922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce602a-7694-4142-bb82-2f0d61a002d2 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:52.982383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5b26f-b44a-4ada-b053-2b05b6e281d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:52.983491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b26f-b44a-4ada-b053-2b05b6e281d2 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:52.983851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b26f-b44a-4ada-b053-2b05b6e281d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:52.984138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b26f-b44a-4ada-b053-2b05b6e281d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:52.984890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b26f-b44a-4ada-b053-2b05b6e281d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:52.985200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b26f-b44a-4ada-b053-2b05b6e281d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:52.987312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b26f-b44a-4ada-b053-2b05b6e281d2 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:53.000353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 543/1073] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:53.008467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52c469-bca7-4c26-9e90-d21891f3ca52 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:53.058387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276e2ff-3e3b-46f9-ba9b-a3815061b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:53.059082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276e2ff-3e3b-46f9-ba9b-a3815061b02b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:53.059364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276e2ff-3e3b-46f9-ba9b-a3815061b02b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:53.059646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276e2ff-3e3b-46f9-ba9b-a3815061b02b None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:53.060499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276e2ff-3e3b-46f9-ba9b-a3815061b02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:53.060812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276e2ff-3e3b-46f9-ba9b-a3815061b02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:53.062237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276e2ff-3e3b-46f9-ba9b-a3815061b02b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:53.081016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 531/1074] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:53.082773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5b26f-b44a-4ada-b053-2b05b6e281d2 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:53.120983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:53.198751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5b26f-b44a-4ada-b053-2b05b6e281d2 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:53.238726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be5954-1d90-46e0-9f58-cd0f49b7db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:53.239440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be5954-1d90-46e0-9f58-cd0f49b7db71 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:53.239717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be5954-1d90-46e0-9f58-cd0f49b7db71 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:53.239987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be5954-1d90-46e0-9f58-cd0f49b7db71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:53.247229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be5954-1d90-46e0-9f58-cd0f49b7db71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:53.253506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be5954-1d90-46e0-9f58-cd0f49b7db71 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-c8be5954-1d90-46e0-9f58-cd0f49b7db71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:53.271449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:53.272492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:53.273505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:53.273505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:53.273505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:53.273505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:53.273505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:53.273505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:53.273505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:53.273505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:53.273505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 544/1075] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:53.279827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276e2ff-3e3b-46f9-ba9b-a3815061b02b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:53.296704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:53.382640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276e2ff-3e3b-46f9-ba9b-a3815061b02b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:53.416259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2e279-5d5c-4bcc-93e2-c18fd53b8333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:53.416944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e279-5d5c-4bcc-93e2-c18fd53b8333 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:53.417225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e279-5d5c-4bcc-93e2-c18fd53b8333 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:53.417509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e279-5d5c-4bcc-93e2-c18fd53b8333 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:53.418291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2e279-5d5c-4bcc-93e2-c18fd53b8333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:53.418605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2e279-5d5c-4bcc-93e2-c18fd53b8333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:53.420048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2e279-5d5c-4bcc-93e2-c18fd53b8333 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:53.432937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 532/1076] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:53.438867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be5954-1d90-46e0-9f58-cd0f49b7db71 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:53.529948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:53.537469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be5954-1d90-46e0-9f58-cd0f49b7db71 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:53.570529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ea6ad-87e2-4ab7-ad5d-9874bf7a935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:53.571416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea6ad-87e2-4ab7-ad5d-9874bf7a935f None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:53.571700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea6ad-87e2-4ab7-ad5d-9874bf7a935f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:53.571976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea6ad-87e2-4ab7-ad5d-9874bf7a935f None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/951eca3289634609bcb684181e147ca3/roles/20e7b7e974a34b60917b112f4314ba18` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:53.574196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ea6ad-87e2-4ab7-ad5d-9874bf7a935f None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=951eca3289634609bcb684181e147ca3, role_id=20e7b7e974a34b60917b112f4314ba18)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:53.575644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ea6ad-87e2-4ab7-ad5d-9874bf7a935f None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:53.634900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 545/1077] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:27:53 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/951eca3289634609bcb684181e147ca3/roles/20e7b7e974a34b60917b112f4314ba18 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:27:53.788977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae7368-2fb5-49cc-a72d-8521edaaa7db None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:53.789496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae7368-2fb5-49cc-a72d-8521edaaa7db None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:53.789496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae7368-2fb5-49cc-a72d-8521edaaa7db None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:53.790835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 533/1078] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:53.796559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5794-2cdb-4c39-ac18-e63405976935 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:53.796850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5794-2cdb-4c39-ac18-e63405976935 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:53.797129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5794-2cdb-4c39-ac18-e63405976935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:53.815901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2f8f5794-2cdb-4c39-ac18-e63405976935 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:53.817152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2f8f5794-2cdb-4c39-ac18-e63405976935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:53.883101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 546/1079] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:27:53.913018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae7368-2fb5-49cc-a72d-8521edaaa7db None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:53.989973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:54.016211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae7368-2fb5-49cc-a72d-8521edaaa7db None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:54.051199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f085e-1982-453c-b53e-f28caad7635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:54.051917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f085e-1982-453c-b53e-f28caad7635f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:54.052202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f085e-1982-453c-b53e-f28caad7635f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:54.052508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f085e-1982-453c-b53e-f28caad7635f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:54.062502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f085e-1982-453c-b53e-f28caad7635f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-134f085e-1982-453c-b53e-f28caad7635f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:54.070270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:54.071398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:54.072322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 534/1080] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:54.077400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f5794-2cdb-4c39-ac18-e63405976935 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:54.159826 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:54.176494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f5794-2cdb-4c39-ac18-e63405976935 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:54.211343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58f421-2f1c-4448-917a-ffd55ee7881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:54.212015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58f421-2f1c-4448-917a-ffd55ee7881e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:54.212410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58f421-2f1c-4448-917a-ffd55ee7881e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:54.212691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58f421-2f1c-4448-917a-ffd55ee7881e None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:54.213437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58f421-2f1c-4448-917a-ffd55ee7881e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:54.213737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58f421-2f1c-4448-917a-ffd55ee7881e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:54.215101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58f421-2f1c-4448-917a-ffd55ee7881e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:54.224107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 547/1081] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:54.229820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f085e-1982-453c-b53e-f28caad7635f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:54.333342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f085e-1982-453c-b53e-f28caad7635f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:54.365338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41776c0c-b8e6-4d42-b55d-9e8a4834009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:54.366206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41776c0c-b8e6-4d42-b55d-9e8a4834009f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:54.366487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41776c0c-b8e6-4d42-b55d-9e8a4834009f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:54.366757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41776c0c-b8e6-4d42-b55d-9e8a4834009f None admin] PATH_INFO: `/v3/users/968a196d7bbd4ad39c8cb9b8f3a1e17e` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:54.367918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41776c0c-b8e6-4d42-b55d-9e8a4834009f None admin] RBAC: Authorizing `identity:get_user(user_id=968a196d7bbd4ad39c8cb9b8f3a1e17e)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:54.369385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41776c0c-b8e6-4d42-b55d-9e8a4834009f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:54.371032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 535/1082] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:27:54 2022] GET /identity/v3/users/968a196d7bbd4ad39c8cb9b8f3a1e17e => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:54.377173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58f421-2f1c-4448-917a-ffd55ee7881e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:54.474306 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58f421-2f1c-4448-917a-ffd55ee7881e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:54.506471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e08fd-00d3-4837-82c2-27f1c2f799a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:54.507314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e08fd-00d3-4837-82c2-27f1c2f799a3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:54.507591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e08fd-00d3-4837-82c2-27f1c2f799a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:54.507859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e08fd-00d3-4837-82c2-27f1c2f799a3 None admin] PATH_INFO: `/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:54.509039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e08fd-00d3-4837-82c2-27f1c2f799a3 None admin] RBAC: Authorizing `identity:get_project(project_id=4e5d0b971f4d4fbda8513172bf49f5ed)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:54.510458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e08fd-00d3-4837-82c2-27f1c2f799a3 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:54.512124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 548/1083] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:27:54 2022] GET /identity/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:54.518822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41776c0c-b8e6-4d42-b55d-9e8a4834009f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:54.521736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:54.621551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41776c0c-b8e6-4d42-b55d-9e8a4834009f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:54.657282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ddb1-f619-484d-94ab-124d3a8fbd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:54.658701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ddb1-f619-484d-94ab-124d3a8fbd33 None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:54.658977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ddb1-f619-484d-94ab-124d3a8fbd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:54.659251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ddb1-f619-484d-94ab-124d3a8fbd33 None admin] PATH_INFO: `/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed/users/968a196d7bbd4ad39c8cb9b8f3a1e17e/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:54.661241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ddb1-f619-484d-94ab-124d3a8fbd33 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e5d0b971f4d4fbda8513172bf49f5ed, user_id=968a196d7bbd4ad39c8cb9b8f3a1e17e, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:54.662669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ddb1-f619-484d-94ab-124d3a8fbd33 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:54.808771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 536/1084] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:27:54 2022] PUT /identity/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed/users/968a196d7bbd4ad39c8cb9b8f3a1e17e/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:55.869108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85c4f5-d338-45fe-b6b7-f128ea693fd0 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:55.869681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85c4f5-d338-45fe-b6b7-f128ea693fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:55.869681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85c4f5-d338-45fe-b6b7-f128ea693fd0 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:55.871015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 549/1085] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:27:55.876489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8548ce-c1fe-473b-b1e5-cdb41895accb None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:55.877307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8548ce-c1fe-473b-b1e5-cdb41895accb None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:55.877307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8548ce-c1fe-473b-b1e5-cdb41895accb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:55.894956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-fb8548ce-c1fe-473b-b1e5-cdb41895accb None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:55.896181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-fb8548ce-c1fe-473b-b1e5-cdb41895accb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:55.952930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:55.963607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 537/1086] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:55.987999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85c4f5-d338-45fe-b6b7-f128ea693fd0 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:56.004622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:56.091581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85c4f5-d338-45fe-b6b7-f128ea693fd0 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:56.125293 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07c730-2fe2-4025-9084-8dae3843d3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:56.126036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07c730-2fe2-4025-9084-8dae3843d3cc None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:56.126787 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07c730-2fe2-4025-9084-8dae3843d3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:56.127085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07c730-2fe2-4025-9084-8dae3843d3cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:56.136921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07c730-2fe2-4025-9084-8dae3843d3cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-9b07c730-2fe2-4025-9084-8dae3843d3cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:56.146232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:56.147443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:56.148418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 550/1087] 10.222.0.74 () {56 vars in 1120 bytes} [Mon May 23 16:27:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:56.153391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8548ce-c1fe-473b-b1e5-cdb41895accb None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:56.255712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8548ce-c1fe-473b-b1e5-cdb41895accb None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:56.288614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb2109-a25d-4fd8-ac33-0afc001ebdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:56.289282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2109-a25d-4fd8-ac33-0afc001ebdae None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:56.289571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2109-a25d-4fd8-ac33-0afc001ebdae None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:56.289848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2109-a25d-4fd8-ac33-0afc001ebdae None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:56.290599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb2109-a25d-4fd8-ac33-0afc001ebdae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:56.290911 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb2109-a25d-4fd8-ac33-0afc001ebdae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:56.292287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb2109-a25d-4fd8-ac33-0afc001ebdae None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:56.301157 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 538/1088] 10.222.0.74 () {56 vars in 1115 bytes} [Mon May 23 16:27:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:56.306814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07c730-2fe2-4025-9084-8dae3843d3cc None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:56.383699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:56.412131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07c730-2fe2-4025-9084-8dae3843d3cc None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:56.446936 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0cd47-487a-42e4-97c1-91df80b0463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:56.447728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0cd47-487a-42e4-97c1-91df80b0463e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:56.448015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0cd47-487a-42e4-97c1-91df80b0463e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:56.448310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0cd47-487a-42e4-97c1-91df80b0463e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:56.459256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0cd47-487a-42e4-97c1-91df80b0463e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:56.460756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0cd47-487a-42e4-97c1-91df80b0463e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-3fd0cd47-487a-42e4-97c1-91df80b0463e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:56.478460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:56.479570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:56.485362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:56.485362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:56.485362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:56.485362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:56.485362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 551/1089] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:56.486416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb2109-a25d-4fd8-ac33-0afc001ebdae None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:56.542068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:56.586685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb2109-a25d-4fd8-ac33-0afc001ebdae None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:56.620410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a24b5-3b4f-4cb6-826e-6b70c03c6ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:56.621066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a24b5-3b4f-4cb6-826e-6b70c03c6ebc None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:56.621352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a24b5-3b4f-4cb6-826e-6b70c03c6ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:56.621628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a24b5-3b4f-4cb6-826e-6b70c03c6ebc None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:56.622348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a24b5-3b4f-4cb6-826e-6b70c03c6ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:56.622654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a24b5-3b4f-4cb6-826e-6b70c03c6ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:56.624029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a24b5-3b4f-4cb6-826e-6b70c03c6ebc None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:56.635667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 539/1090] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:56.641372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0cd47-487a-42e4-97c1-91df80b0463e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:56.738164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0cd47-487a-42e4-97c1-91df80b0463e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:56.810319 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:56.820268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecd86e-6812-4412-8674-065027a1d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:56.821114 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecd86e-6812-4412-8674-065027a1d87e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:56.821397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecd86e-6812-4412-8674-065027a1d87e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:56.821672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecd86e-6812-4412-8674-065027a1d87e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:56.830244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecd86e-6812-4412-8674-065027a1d87e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:56.831710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecd86e-6812-4412-8674-065027a1d87e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-0fecd86e-6812-4412-8674-065027a1d87e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:27:56.846567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:56.847620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:56.848677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 552/1091] 10.222.0.74 () {56 vars in 1093 bytes} [Mon May 23 16:27:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:56.855066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a24b5-3b4f-4cb6-826e-6b70c03c6ebc None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:56.952686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a24b5-3b4f-4cb6-826e-6b70c03c6ebc None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:56.967773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:56.987855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb24f93-448a-4543-b782-071a9945253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:56.988546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb24f93-448a-4543-b782-071a9945253a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:56.988834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb24f93-448a-4543-b782-071a9945253a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:56.989109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb24f93-448a-4543-b782-071a9945253a None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:56.990008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb24f93-448a-4543-b782-071a9945253a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:56.990314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb24f93-448a-4543-b782-071a9945253a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:56.991751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb24f93-448a-4543-b782-071a9945253a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:56.996537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd98a4-683b-40c1-bc8f-81409ca8fd5b None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:56.997002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd98a4-683b-40c1-bc8f-81409ca8fd5b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:56.997108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd98a4-683b-40c1-bc8f-81409ca8fd5b None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:56.998432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 553/1092] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:27:57.004055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8c878-5361-4e97-a623-abe06dbbb82a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.004361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8c878-5361-4e97-a623-abe06dbbb82a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.004637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8c878-5361-4e97-a623-abe06dbbb82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.010152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 540/1093] 10.222.0.74 () {56 vars in 1133 bytes} [Mon May 23 16:27:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:57.016235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb24f93-448a-4543-b782-071a9945253a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.021637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-83d8c878-5361-4e97-a623-abe06dbbb82a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:57.022805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-83d8c878-5361-4e97-a623-abe06dbbb82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:57.088929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 554/1094] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:27:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:27:57.112407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8c878-5361-4e97-a623-abe06dbbb82a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.116225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb24f93-448a-4543-b782-071a9945253a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:57.150548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409c677-f626-4c98-92df-33602de15af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:57.151195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409c677-f626-4c98-92df-33602de15af8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.151482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409c677-f626-4c98-92df-33602de15af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.151760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409c677-f626-4c98-92df-33602de15af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.194570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:57.214449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8c878-5361-4e97-a623-abe06dbbb82a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:57.223534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409c677-f626-4c98-92df-33602de15af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:57.225048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409c677-f626-4c98-92df-33602de15af8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:57.231101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:57.248723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd2aff-dfee-4056-ade6-4b16b95f6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:57.249627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd2aff-dfee-4056-ade6-4b16b95f6004 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.249921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd2aff-dfee-4056-ade6-4b16b95f6004 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.250198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd2aff-dfee-4056-ade6-4b16b95f6004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.261913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd2aff-dfee-4056-ade6-4b16b95f6004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-6acd2aff-dfee-4056-ade6-4b16b95f6004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:27:57.270388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:57.271333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:27:57.272191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 555/1095] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:57.277418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd2aff-dfee-4056-ade6-4b16b95f6004 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.326435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 541/1096] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:27:57.332282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409c677-f626-4c98-92df-33602de15af8 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.377139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd2aff-dfee-4056-ade6-4b16b95f6004 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:57.398848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:57.410824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3de864-195e-43bc-8d2e-11ed780878a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:57.412606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3de864-195e-43bc-8d2e-11ed780878a5 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.412606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3de864-195e-43bc-8d2e-11ed780878a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.412606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3de864-195e-43bc-8d2e-11ed780878a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.412923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3de864-195e-43bc-8d2e-11ed780878a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:57.413126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3de864-195e-43bc-8d2e-11ed780878a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:57.414491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3de864-195e-43bc-8d2e-11ed780878a5 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:57.423608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 556/1097] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:57.427942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409c677-f626-4c98-92df-33602de15af8 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:57.429336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3de864-195e-43bc-8d2e-11ed780878a5 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.462102 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f505f-8440-4caa-9c00-281b8f57fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:57.462894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f505f-8440-4caa-9c00-281b8f57fe80 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.463179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f505f-8440-4caa-9c00-281b8f57fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.463458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f505f-8440-4caa-9c00-281b8f57fe80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.468263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:57.473997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f505f-8440-4caa-9c00-281b8f57fe80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:57.475443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f505f-8440-4caa-9c00-281b8f57fe80 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-911f505f-8440-4caa-9c00-281b8f57fe80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:27:57.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:57.494615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:57.495552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:27:57.495552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:27:57.495552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:27:57.495552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:57.495552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 542/1098] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:27:57.500256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f505f-8440-4caa-9c00-281b8f57fe80 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.534165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3de864-195e-43bc-8d2e-11ed780878a5 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:57.566995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ec9c-43b6-4783-b782-771c59dddcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:57.567852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ec9c-43b6-4783-b782-771c59dddcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.568131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ec9c-43b6-4783-b782-771c59dddcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.568444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ec9c-43b6-4783-b782-771c59dddcc5 None admin] PATH_INFO: `/v3/users/968a196d7bbd4ad39c8cb9b8f3a1e17e` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.569629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327ec9c-43b6-4783-b782-771c59dddcc5 None admin] RBAC: Authorizing `identity:get_user(user_id=968a196d7bbd4ad39c8cb9b8f3a1e17e)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:57.571051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327ec9c-43b6-4783-b782-771c59dddcc5 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:57.572862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 557/1099] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/users/968a196d7bbd4ad39c8cb9b8f3a1e17e => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:57.578312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ec9c-43b6-4783-b782-771c59dddcc5 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.599378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f505f-8440-4caa-9c00-281b8f57fe80 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:57.622006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:57.632587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ecb5f-b86c-49a2-bd62-6234252ced53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:57.633246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ecb5f-b86c-49a2-bd62-6234252ced53 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.633532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ecb5f-b86c-49a2-bd62-6234252ced53 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.633811 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ecb5f-b86c-49a2-bd62-6234252ced53 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.634537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ecb5f-b86c-49a2-bd62-6234252ced53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:57.634852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ecb5f-b86c-49a2-bd62-6234252ced53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:57.636233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ecb5f-b86c-49a2-bd62-6234252ced53 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:57.648199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 543/1100] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:57.653688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ecb5f-b86c-49a2-bd62-6234252ced53 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.678265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ec9c-43b6-4783-b782-771c59dddcc5 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:57.685160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:57.711715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480e83b-e286-46a1-890c-5e6107a563cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:57.712413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480e83b-e286-46a1-890c-5e6107a563cd None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.712692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480e83b-e286-46a1-890c-5e6107a563cd None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.712962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480e83b-e286-46a1-890c-5e6107a563cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.757204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ecb5f-b86c-49a2-bd62-6234252ced53 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:57.811060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba727e8-4749-490d-b623-242f62bea2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:57.811844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba727e8-4749-490d-b623-242f62bea2ff None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.812119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba727e8-4749-490d-b623-242f62bea2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.812433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba727e8-4749-490d-b623-242f62bea2ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.813407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480e83b-e286-46a1-890c-5e6107a563cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:57.814894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480e83b-e286-46a1-890c-5e6107a563cd None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:57.819547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba727e8-4749-490d-b623-242f62bea2ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:57.821075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba727e8-4749-490d-b623-242f62bea2ff None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-eba727e8-4749-490d-b623-242f62bea2ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:27:57.835764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:27:57.836812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:27:57.837749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:27:57.837749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:27:57.837749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:27:57.837749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:27:57.837749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:27:57.837749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:27:57.837749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:27:57.837749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:27:57.837749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 544/1101] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:27:57.842661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba727e8-4749-490d-b623-242f62bea2ff None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.887134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:57.912951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 558/1102] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 16:27:57.918780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480e83b-e286-46a1-890c-5e6107a563cd None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:57.927543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:57.941126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba727e8-4749-490d-b623-242f62bea2ff None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:57.975708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373d340-89b8-40b3-9093-0bcac6f7ca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:57.976393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d340-89b8-40b3-9093-0bcac6f7ca92 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:57.976677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d340-89b8-40b3-9093-0bcac6f7ca92 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:57.976953 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d340-89b8-40b3-9093-0bcac6f7ca92 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:57.977740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373d340-89b8-40b3-9093-0bcac6f7ca92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:57.978051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373d340-89b8-40b3-9093-0bcac6f7ca92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:57.979488 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373d340-89b8-40b3-9093-0bcac6f7ca92 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:57.991446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 545/1103] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:57.997407 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373d340-89b8-40b3-9093-0bcac6f7ca92 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:58.019342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480e83b-e286-46a1-890c-5e6107a563cd None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:58.054242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c9ee7-d542-4a66-b6be-bbeb0bdb6c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:58.055098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c9ee7-d542-4a66-b6be-bbeb0bdb6c1a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:58.055383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c9ee7-d542-4a66-b6be-bbeb0bdb6c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:58.055663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c9ee7-d542-4a66-b6be-bbeb0bdb6c1a None admin] PATH_INFO: `/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:58.056882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c9ee7-d542-4a66-b6be-bbeb0bdb6c1a None admin] RBAC: Authorizing `identity:get_project(project_id=4e5d0b971f4d4fbda8513172bf49f5ed)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:58.058318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c9ee7-d542-4a66-b6be-bbeb0bdb6c1a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:58.059987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 559/1104] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:58.066166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c9ee7-d542-4a66-b6be-bbeb0bdb6c1a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:58.096211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373d340-89b8-40b3-9093-0bcac6f7ca92 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:58.098518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:58.130397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9ef03-d314-4086-8f0a-b7f648b50c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:58.131045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9ef03-d314-4086-8f0a-b7f648b50c18 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:58.131329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9ef03-d314-4086-8f0a-b7f648b50c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:58.132034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9ef03-d314-4086-8f0a-b7f648b50c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:58.132470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9ef03-d314-4086-8f0a-b7f648b50c18 None admin] RBAC: Adding query filter params (role.id=20e7b7e974a34b60917b112f4314ba18, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=951eca3289634609bcb684181e147ca3) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:58.132784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9ef03-d314-4086-8f0a-b7f648b50c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:58.134211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9ef03-d314-4086-8f0a-b7f648b50c18 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:58.140155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:58.140289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 546/1105] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:57 2022] GET /identity/v3/role_assignments?user.id=951eca3289634609bcb684181e147ca3&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=20e7b7e974a34b60917b112f4314ba18 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:27:58.166288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c9ee7-d542-4a66-b6be-bbeb0bdb6c1a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:58.203849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863a75f-995d-44cb-a8a3-0280e19a61e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:58.205588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863a75f-995d-44cb-a8a3-0280e19a61e6 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:58.205866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863a75f-995d-44cb-a8a3-0280e19a61e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:58.206138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863a75f-995d-44cb-a8a3-0280e19a61e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:58.206991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863a75f-995d-44cb-a8a3-0280e19a61e6 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=4e5d0b971f4d4fbda8513172bf49f5ed, user.id=968a196d7bbd4ad39c8cb9b8f3a1e17e) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:58.207301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863a75f-995d-44cb-a8a3-0280e19a61e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:58.208813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863a75f-995d-44cb-a8a3-0280e19a61e6 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:58.215890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 560/1106] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:27:58 2022] GET /identity/v3/role_assignments?user.id=968a196d7bbd4ad39c8cb9b8f3a1e17e&scope.project.id=4e5d0b971f4d4fbda8513172bf49f5ed&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:28:00.470486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf518-6f66-43c7-986d-ca01c341db6d None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:00.471064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf518-6f66-43c7-986d-ca01c341db6d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:00.471064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf518-6f66-43c7-986d-ca01c341db6d None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:00.472318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 547/1107] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:00.477587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f547e0-0dd7-407a-984e-093f1fc920c7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:00.478033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f547e0-0dd7-407a-984e-093f1fc920c7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:00.478137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f547e0-0dd7-407a-984e-093f1fc920c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:00.495216 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-69f547e0-0dd7-407a-984e-093f1fc920c7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:00.496417 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-69f547e0-0dd7-407a-984e-093f1fc920c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:00.560415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 561/1108] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:00.585026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bf518-6f66-43c7-986d-ca01c341db6d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:00.692199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bf518-6f66-43c7-986d-ca01c341db6d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:00.725800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203775df-fd99-4f89-98ab-b9c46acd55f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:00.726510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203775df-fd99-4f89-98ab-b9c46acd55f7 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:00.726790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203775df-fd99-4f89-98ab-b9c46acd55f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:00.727060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203775df-fd99-4f89-98ab-b9c46acd55f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:00.728200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203775df-fd99-4f89-98ab-b9c46acd55f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:00.729660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203775df-fd99-4f89-98ab-b9c46acd55f7 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:00.731255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 548/1109] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:28:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:00.737016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f547e0-0dd7-407a-984e-093f1fc920c7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:00.800308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:00.831809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f547e0-0dd7-407a-984e-093f1fc920c7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:00.865353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08693ff3-ac2b-46f2-8572-06efb3d2975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:00.866014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08693ff3-ac2b-46f2-8572-06efb3d2975a None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:00.866297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08693ff3-ac2b-46f2-8572-06efb3d2975a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:00.866574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08693ff3-ac2b-46f2-8572-06efb3d2975a None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:00.867270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08693ff3-ac2b-46f2-8572-06efb3d2975a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:00.868727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08693ff3-ac2b-46f2-8572-06efb3d2975a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:00.945446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 562/1110] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:28:00 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:28:03.158493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037645-239d-445c-8ba8-74fb110d7bdd None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:03.159024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037645-239d-445c-8ba8-74fb110d7bdd None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:03.159170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037645-239d-445c-8ba8-74fb110d7bdd None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:03.160582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 549/1111] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:03.165801 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dd423-698a-40cc-9c02-8d3d27f54fb3 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:03.166245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dd423-698a-40cc-9c02-8d3d27f54fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:03.166382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dd423-698a-40cc-9c02-8d3d27f54fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:03.183557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-658dd423-698a-40cc-9c02-8d3d27f54fb3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:03.184772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-658dd423-698a-40cc-9c02-8d3d27f54fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:03.251470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 563/1112] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:03.275633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd037645-239d-445c-8ba8-74fb110d7bdd None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:03.311390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:03.374432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd037645-239d-445c-8ba8-74fb110d7bdd None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:03.406787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de827-7774-404d-ba40-1fa686567ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:03.408160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de827-7774-404d-ba40-1fa686567ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:03.408467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de827-7774-404d-ba40-1fa686567ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:03.408792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de827-7774-404d-ba40-1fa686567ef9 None admin] PATH_INFO: `/v3/roles/c07ef3c8c1574bb987c394026b04fb39` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:03.410201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de827-7774-404d-ba40-1fa686567ef9 None admin] RBAC: Authorizing `identity:get_role(role_id=c07ef3c8c1574bb987c394026b04fb39)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:03.411565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de827-7774-404d-ba40-1fa686567ef9 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:03.412962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 550/1113] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:03 2022] GET /identity/v3/roles/c07ef3c8c1574bb987c394026b04fb39 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:03.418788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dd423-698a-40cc-9c02-8d3d27f54fb3 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:03.473222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:03.517754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dd423-698a-40cc-9c02-8d3d27f54fb3 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:03.551377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033fca2-24e2-49cd-b2bf-66956eaf8071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:03.552240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033fca2-24e2-49cd-b2bf-66956eaf8071 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:03.552555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033fca2-24e2-49cd-b2bf-66956eaf8071 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:03.552833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033fca2-24e2-49cd-b2bf-66956eaf8071 None admin] PATH_INFO: `/v3/users/93456e173de04b7080a214724961c1a6` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:03.568200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033fca2-24e2-49cd-b2bf-66956eaf8071 None admin] RBAC: Authorizing `identity:get_user(user_id=93456e173de04b7080a214724961c1a6)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:03.569677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033fca2-24e2-49cd-b2bf-66956eaf8071 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:03.571317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 564/1114] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:03 2022] GET /identity/v3/users/93456e173de04b7080a214724961c1a6 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:03.577116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de827-7774-404d-ba40-1fa686567ef9 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:03.676619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de827-7774-404d-ba40-1fa686567ef9 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:03.678880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:03.710196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cf5e3-54ad-45e1-99f6-bf996ec635d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:03.710836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cf5e3-54ad-45e1-99f6-bf996ec635d3 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:03.711125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cf5e3-54ad-45e1-99f6-bf996ec635d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:03.711462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cf5e3-54ad-45e1-99f6-bf996ec635d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:03.776805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cf5e3-54ad-45e1-99f6-bf996ec635d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:03.778283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cf5e3-54ad-45e1-99f6-bf996ec635d3 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:03.900406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 551/1115] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:28:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:28:03.906287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033fca2-24e2-49cd-b2bf-66956eaf8071 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:04.003843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033fca2-24e2-49cd-b2bf-66956eaf8071 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:04.017248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:04.037222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648db8-9c72-40fd-924c-8c5a2cf94ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:04.038066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648db8-9c72-40fd-924c-8c5a2cf94ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:04.043986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648db8-9c72-40fd-924c-8c5a2cf94ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:04.043986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648db8-9c72-40fd-924c-8c5a2cf94ac1 None admin] PATH_INFO: `/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:04.043986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac648db8-9c72-40fd-924c-8c5a2cf94ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=4e5d0b971f4d4fbda8513172bf49f5ed)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:04.043986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac648db8-9c72-40fd-924c-8c5a2cf94ac1 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:04.043986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 565/1116] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:28:03 2022] GET /identity/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:04.048881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cf5e3-54ad-45e1-99f6-bf996ec635d3 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:04.051889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:04.148598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cf5e3-54ad-45e1-99f6-bf996ec635d3 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:04.181185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaba48-9ff8-4dbf-a0f1-cd2bc2e27aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:04.181828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaba48-9ff8-4dbf-a0f1-cd2bc2e27aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:04.182113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaba48-9ff8-4dbf-a0f1-cd2bc2e27aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:04.182390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaba48-9ff8-4dbf-a0f1-cd2bc2e27aa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:04.183207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaba48-9ff8-4dbf-a0f1-cd2bc2e27aa4 None admin] RBAC: Adding query filter params (role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=4e5d0b971f4d4fbda8513172bf49f5ed, user.id=93456e173de04b7080a214724961c1a6) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:04.183547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaba48-9ff8-4dbf-a0f1-cd2bc2e27aa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:04.184998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaba48-9ff8-4dbf-a0f1-cd2bc2e27aa4 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:04.190902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 552/1117] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:28:04 2022] GET /identity/v3/role_assignments?user.id=93456e173de04b7080a214724961c1a6&scope.project.id=4e5d0b971f4d4fbda8513172bf49f5ed&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:28:06.404552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1c087-b3b1-44b7-aec7-d621260b497c None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:06.405067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1c087-b3b1-44b7-aec7-d621260b497c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:06.405067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1c087-b3b1-44b7-aec7-d621260b497c None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:06.406400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 566/1118] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:06.412770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9135c0-0c26-47c0-bb9f-06e82d5dd33f None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:06.413155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9135c0-0c26-47c0-bb9f-06e82d5dd33f None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:06.413322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9135c0-0c26-47c0-bb9f-06e82d5dd33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:06.430260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-aa9135c0-0c26-47c0-bb9f-06e82d5dd33f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:06.431457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-aa9135c0-0c26-47c0-bb9f-06e82d5dd33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:06.490507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:06.495584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 553/1119] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:06.518612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1c087-b3b1-44b7-aec7-d621260b497c None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:06.616308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1c087-b3b1-44b7-aec7-d621260b497c None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:06.649055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10891db-61c5-4983-b4df-2eb8607db573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:06.649892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10891db-61c5-4983-b4df-2eb8607db573 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:06.650172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10891db-61c5-4983-b4df-2eb8607db573 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:06.650443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10891db-61c5-4983-b4df-2eb8607db573 None admin] PATH_INFO: `/v3/roles/c07ef3c8c1574bb987c394026b04fb39` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:06.651897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10891db-61c5-4983-b4df-2eb8607db573 None admin] RBAC: Authorizing `identity:get_role(role_id=c07ef3c8c1574bb987c394026b04fb39)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:06.653288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10891db-61c5-4983-b4df-2eb8607db573 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:06.654618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 567/1120] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:06 2022] GET /identity/v3/roles/c07ef3c8c1574bb987c394026b04fb39 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:06.660960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9135c0-0c26-47c0-bb9f-06e82d5dd33f None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:06.762209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9135c0-0c26-47c0-bb9f-06e82d5dd33f None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:06.795897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64282-bc05-4d42-88f8-7963c65a58ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:06.796784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64282-bc05-4d42-88f8-7963c65a58ff None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:06.797073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64282-bc05-4d42-88f8-7963c65a58ff None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:06.797350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64282-bc05-4d42-88f8-7963c65a58ff None admin] PATH_INFO: `/v3/users/93456e173de04b7080a214724961c1a6` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:06.798550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d64282-bc05-4d42-88f8-7963c65a58ff None admin] RBAC: Authorizing `identity:get_user(user_id=93456e173de04b7080a214724961c1a6)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:06.799978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d64282-bc05-4d42-88f8-7963c65a58ff None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:06.801634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 554/1121] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:06 2022] GET /identity/v3/users/93456e173de04b7080a214724961c1a6 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:06.807341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10891db-61c5-4983-b4df-2eb8607db573 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:06.854999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:06.903086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10891db-61c5-4983-b4df-2eb8607db573 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:06.935267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0b639-4999-4cd1-899d-cd0d738e616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:06.936104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b639-4999-4cd1-899d-cd0d738e616c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:06.936409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b639-4999-4cd1-899d-cd0d738e616c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:06.936686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b639-4999-4cd1-899d-cd0d738e616c None admin] PATH_INFO: `/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:06.937833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b639-4999-4cd1-899d-cd0d738e616c None admin] RBAC: Authorizing `identity:get_project(project_id=4e5d0b971f4d4fbda8513172bf49f5ed)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:06.939924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b639-4999-4cd1-899d-cd0d738e616c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:06.941602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 568/1122] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:28:06 2022] GET /identity/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:06.947617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64282-bc05-4d42-88f8-7963c65a58ff None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:07.011117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:07.045204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64282-bc05-4d42-88f8-7963c65a58ff None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:07.079362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177c88-2b68-4c4a-98a6-943cafc10fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:07.080314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177c88-2b68-4c4a-98a6-943cafc10fa1 None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:07.080606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177c88-2b68-4c4a-98a6-943cafc10fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:07.080880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177c88-2b68-4c4a-98a6-943cafc10fa1 None admin] PATH_INFO: `/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed/users/93456e173de04b7080a214724961c1a6/roles/c07ef3c8c1574bb987c394026b04fb39` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:07.083049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23177c88-2b68-4c4a-98a6-943cafc10fa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e5d0b971f4d4fbda8513172bf49f5ed, user_id=93456e173de04b7080a214724961c1a6, role_id=c07ef3c8c1574bb987c394026b04fb39)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:07.084514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23177c88-2b68-4c4a-98a6-943cafc10fa1 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:07.152917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 555/1123] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:28:06 2022] PUT /identity/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed/users/93456e173de04b7080a214724961c1a6/roles/c07ef3c8c1574bb987c394026b04fb39 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:28:09.347113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153f993-1e05-4801-b3f3-ee57019e4325 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:09.347628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153f993-1e05-4801-b3f3-ee57019e4325 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:09.347741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153f993-1e05-4801-b3f3-ee57019e4325 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:09.349077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 569/1124] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:09.354500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb77ee5-3e81-4dbf-a6d6-3343589a546d None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:09.354913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb77ee5-3e81-4dbf-a6d6-3343589a546d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:09.355058 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb77ee5-3e81-4dbf-a6d6-3343589a546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:09.372009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2eb77ee5-3e81-4dbf-a6d6-3343589a546d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:09.373247 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2eb77ee5-3e81-4dbf-a6d6-3343589a546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:09.439638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 556/1125] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:09.463233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153f993-1e05-4801-b3f3-ee57019e4325 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:09.565152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153f993-1e05-4801-b3f3-ee57019e4325 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:09.581795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:09.599500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458b47-e2d2-4ff4-82bc-c69b2f8b62ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:09.600413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458b47-e2d2-4ff4-82bc-c69b2f8b62ec None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:09.600734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458b47-e2d2-4ff4-82bc-c69b2f8b62ec None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:09.601004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458b47-e2d2-4ff4-82bc-c69b2f8b62ec None admin] PATH_INFO: `/v3/roles/c07ef3c8c1574bb987c394026b04fb39` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:09.602452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29458b47-e2d2-4ff4-82bc-c69b2f8b62ec None admin] RBAC: Authorizing `identity:get_role(role_id=c07ef3c8c1574bb987c394026b04fb39)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:09.603867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29458b47-e2d2-4ff4-82bc-c69b2f8b62ec None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:09.605252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 570/1126] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:09 2022] GET /identity/v3/roles/c07ef3c8c1574bb987c394026b04fb39 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:09.611073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb77ee5-3e81-4dbf-a6d6-3343589a546d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:09.668529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:09.710819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb77ee5-3e81-4dbf-a6d6-3343589a546d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:09.744268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45f68-ed90-452c-8fdd-780384cc2938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:09.745150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45f68-ed90-452c-8fdd-780384cc2938 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:09.745429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45f68-ed90-452c-8fdd-780384cc2938 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:09.745701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45f68-ed90-452c-8fdd-780384cc2938 None admin] PATH_INFO: `/v3/users/93456e173de04b7080a214724961c1a6` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:09.746860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f45f68-ed90-452c-8fdd-780384cc2938 None admin] RBAC: Authorizing `identity:get_user(user_id=93456e173de04b7080a214724961c1a6)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:09.748290 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f45f68-ed90-452c-8fdd-780384cc2938 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:09.749923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 557/1127] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:09 2022] GET /identity/v3/users/93456e173de04b7080a214724961c1a6 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:09.755705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458b47-e2d2-4ff4-82bc-c69b2f8b62ec None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:09.854079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458b47-e2d2-4ff4-82bc-c69b2f8b62ec None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:09.886173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a779-c5d2-412a-a55a-7e6a30b1174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:09.886809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a779-c5d2-412a-a55a-7e6a30b1174a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:09.887097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a779-c5d2-412a-a55a-7e6a30b1174a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:09.887373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a779-c5d2-412a-a55a-7e6a30b1174a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:09.937419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:09.953328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675a779-c5d2-412a-a55a-7e6a30b1174a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:09.955396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675a779-c5d2-412a-a55a-7e6a30b1174a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:10.052035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 571/1128] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:28:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:28:10.058013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45f68-ed90-452c-8fdd-780384cc2938 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:10.153774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45f68-ed90-452c-8fdd-780384cc2938 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:10.175605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:10.185709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b61bd-9fd7-4a16-bc75-85a6f5338de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:10.186551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b61bd-9fd7-4a16-bc75-85a6f5338de8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:10.186832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b61bd-9fd7-4a16-bc75-85a6f5338de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:10.187102 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b61bd-9fd7-4a16-bc75-85a6f5338de8 None admin] PATH_INFO: `/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:10.188801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b61bd-9fd7-4a16-bc75-85a6f5338de8 None admin] RBAC: Authorizing `identity:get_project(project_id=4e5d0b971f4d4fbda8513172bf49f5ed)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:10.190297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b61bd-9fd7-4a16-bc75-85a6f5338de8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:10.191975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 558/1129] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:28:10 2022] GET /identity/v3/projects/4e5d0b971f4d4fbda8513172bf49f5ed => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:10.197947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a779-c5d2-412a-a55a-7e6a30b1174a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:10.280699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:10.296042 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a779-c5d2-412a-a55a-7e6a30b1174a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:10.330207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4d57b-7351-4016-a0f7-284ec74990c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:10.330849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d57b-7351-4016-a0f7-284ec74990c8 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:10.331132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d57b-7351-4016-a0f7-284ec74990c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:10.331405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d57b-7351-4016-a0f7-284ec74990c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:10.332232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4d57b-7351-4016-a0f7-284ec74990c8 None admin] RBAC: Adding query filter params (role.id=c07ef3c8c1574bb987c394026b04fb39, scope.project.id=4e5d0b971f4d4fbda8513172bf49f5ed, user.id=93456e173de04b7080a214724961c1a6) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:10.332575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4d57b-7351-4016-a0f7-284ec74990c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:10.333998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4d57b-7351-4016-a0f7-284ec74990c8 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:10.339959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 572/1130] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:28:10 2022] GET /identity/v3/role_assignments?user.id=93456e173de04b7080a214724961c1a6&scope.project.id=4e5d0b971f4d4fbda8513172bf49f5ed&role.id=c07ef3c8c1574bb987c394026b04fb39 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:12.530665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139da9-fc51-4bc2-a150-187784afc03e None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:12.531238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139da9-fc51-4bc2-a150-187784afc03e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:12.531238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139da9-fc51-4bc2-a150-187784afc03e None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:12.533289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 559/1131] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:12.538628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf2253-6a4d-43c2-9d6a-5dd527ea7ee9 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:12.539019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf2253-6a4d-43c2-9d6a-5dd527ea7ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:12.539187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf2253-6a4d-43c2-9d6a-5dd527ea7ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:12.555991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-3edf2253-6a4d-43c2-9d6a-5dd527ea7ee9 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:12.557199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3edf2253-6a4d-43c2-9d6a-5dd527ea7ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:12.623375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 573/1132] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:12.647845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139da9-fc51-4bc2-a150-187784afc03e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:12.744950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139da9-fc51-4bc2-a150-187784afc03e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:12.777796 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee07753-3513-4f6f-a80f-f2fc5bb6c7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:12.778575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee07753-3513-4f6f-a80f-f2fc5bb6c7fb None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:12.778861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee07753-3513-4f6f-a80f-f2fc5bb6c7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:12.779139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee07753-3513-4f6f-a80f-f2fc5bb6c7fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:12.780330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee07753-3513-4f6f-a80f-f2fc5bb6c7fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:12.782624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee07753-3513-4f6f-a80f-f2fc5bb6c7fb None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:12.784198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 560/1133] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:28:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:12.789856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf2253-6a4d-43c2-9d6a-5dd527ea7ee9 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:12.864435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:12.884642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf2253-6a4d-43c2-9d6a-5dd527ea7ee9 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:12.918478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedbb0b-702b-4f14-b7d2-4e4d7f0e466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:12.919134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedbb0b-702b-4f14-b7d2-4e4d7f0e466c None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:12.919418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedbb0b-702b-4f14-b7d2-4e4d7f0e466c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:12.919700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedbb0b-702b-4f14-b7d2-4e4d7f0e466c None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:12.920445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedbb0b-702b-4f14-b7d2-4e4d7f0e466c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:12.921877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedbb0b-702b-4f14-b7d2-4e4d7f0e466c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:13.042510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 574/1134] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:28:12 2022] POST /identity/v3/projects => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:28:15.279186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b9699-52a6-48cd-8f04-003c9ee33846 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:15.279660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b9699-52a6-48cd-8f04-003c9ee33846 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:15.279750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b9699-52a6-48cd-8f04-003c9ee33846 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:15.281150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 561/1135] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:15.286938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d459d5-fb99-464e-b3a6-f0f7a13930ad None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:15.287365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d459d5-fb99-464e-b3a6-f0f7a13930ad None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:15.287491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d459d5-fb99-464e-b3a6-f0f7a13930ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:15.303958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c9d459d5-fb99-464e-b3a6-f0f7a13930ad None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:15.306235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c9d459d5-fb99-464e-b3a6-f0f7a13930ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:15.370852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 575/1136] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:15.397351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b9699-52a6-48cd-8f04-003c9ee33846 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:15.456540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:15.495266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b9699-52a6-48cd-8f04-003c9ee33846 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:15.529782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc017f-8de5-426a-b081-c9e4b5ab5a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:15.530561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc017f-8de5-426a-b081-c9e4b5ab5a45 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:15.530841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc017f-8de5-426a-b081-c9e4b5ab5a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:15.531114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc017f-8de5-426a-b081-c9e4b5ab5a45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:15.532439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc017f-8de5-426a-b081-c9e4b5ab5a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:15.533871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc017f-8de5-426a-b081-c9e4b5ab5a45 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:15.535486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 562/1137] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:28:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:15.541240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d459d5-fb99-464e-b3a6-f0f7a13930ad None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:15.597845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:15.637190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d459d5-fb99-464e-b3a6-f0f7a13930ad None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:15.669689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daf257-174c-4520-879f-42c4dbc47b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:15.670339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf257-174c-4520-879f-42c4dbc47b0c None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:15.670617 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf257-174c-4520-879f-42c4dbc47b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:15.670888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf257-174c-4520-879f-42c4dbc47b0c None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:15.671585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf257-174c-4520-879f-42c4dbc47b0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:15.673691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf257-174c-4520-879f-42c4dbc47b0c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:15.754104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 576/1138] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:28:15 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:28:17.982392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea03a3-db5d-4c55-994d-463e1a3324fb None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:17.982934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea03a3-db5d-4c55-994d-463e1a3324fb None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:17.982934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea03a3-db5d-4c55-994d-463e1a3324fb None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:17.984840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 563/1139] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:17.990161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c10ed7-4d5d-49bd-beb1-a249fa3d239b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:17.990577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c10ed7-4d5d-49bd-beb1-a249fa3d239b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:17.990725 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c10ed7-4d5d-49bd-beb1-a249fa3d239b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:18.008321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a5c10ed7-4d5d-49bd-beb1-a249fa3d239b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:18.009486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a5c10ed7-4d5d-49bd-beb1-a249fa3d239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:18.074191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 577/1140] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:18.097077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea03a3-db5d-4c55-994d-463e1a3324fb None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:18.196520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea03a3-db5d-4c55-994d-463e1a3324fb None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:18.223142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:18.230641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee02b1-a35b-4e63-8e89-cb25da80ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:18.231421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee02b1-a35b-4e63-8e89-cb25da80ebdf None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:18.231700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee02b1-a35b-4e63-8e89-cb25da80ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:18.231972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee02b1-a35b-4e63-8e89-cb25da80ebdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:18.242598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee02b1-a35b-4e63-8e89-cb25da80ebdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-bbee02b1-a35b-4e63-8e89-cb25da80ebdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:28:18.250566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:28:18.251646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:28:18.252591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 564/1141] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:28:18.257839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c10ed7-4d5d-49bd-beb1-a249fa3d239b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:18.304465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:18.356285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c10ed7-4d5d-49bd-beb1-a249fa3d239b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:18.391650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb28518-f662-4858-a3b8-e21e9684e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:18.392338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb28518-f662-4858-a3b8-e21e9684e67d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:18.392632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb28518-f662-4858-a3b8-e21e9684e67d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:18.392911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb28518-f662-4858-a3b8-e21e9684e67d None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:18.393652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb28518-f662-4858-a3b8-e21e9684e67d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:18.393957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb28518-f662-4858-a3b8-e21e9684e67d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:18.395327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb28518-f662-4858-a3b8-e21e9684e67d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:18.403120 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 578/1142] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:18.409456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee02b1-a35b-4e63-8e89-cb25da80ebdf None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:18.508135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee02b1-a35b-4e63-8e89-cb25da80ebdf None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:18.541727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c22dad-44f2-4804-8ef6-f4e3720b3ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:18.542592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22dad-44f2-4804-8ef6-f4e3720b3ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:18.542878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22dad-44f2-4804-8ef6-f4e3720b3ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:18.543195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22dad-44f2-4804-8ef6-f4e3720b3ab5 None admin] PATH_INFO: `/v3/users/7e8bbf2355044615b949799eb9b6b3cb` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:18.556546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c22dad-44f2-4804-8ef6-f4e3720b3ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=7e8bbf2355044615b949799eb9b6b3cb)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:18.558008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c22dad-44f2-4804-8ef6-f4e3720b3ab5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:18.559680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 565/1143] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:18 2022] GET /identity/v3/users/7e8bbf2355044615b949799eb9b6b3cb => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:18.565606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb28518-f662-4858-a3b8-e21e9684e67d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:18.665383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb28518-f662-4858-a3b8-e21e9684e67d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:18.674311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:18.698229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329fdbd-d4b5-4168-96f0-a2029e2e0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:18.698904 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329fdbd-d4b5-4168-96f0-a2029e2e0898 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:18.699188 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329fdbd-d4b5-4168-96f0-a2029e2e0898 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:18.699467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329fdbd-d4b5-4168-96f0-a2029e2e0898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:18.766834 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329fdbd-d4b5-4168-96f0-a2029e2e0898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:18.768283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329fdbd-d4b5-4168-96f0-a2029e2e0898 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:18.862255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 579/1144] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:28:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:28:18.868077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c22dad-44f2-4804-8ef6-f4e3720b3ab5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:18.913825 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:18.964814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c22dad-44f2-4804-8ef6-f4e3720b3ab5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:18.996840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3e366-2af4-48cf-865d-baf7964c6569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:18.997686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3e366-2af4-48cf-865d-baf7964c6569 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:18.997967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3e366-2af4-48cf-865d-baf7964c6569 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:18.998236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3e366-2af4-48cf-865d-baf7964c6569 None admin] PATH_INFO: `/v3/projects/32866849f2c3432bb88295c8bab0bfc3` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:18.999393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3e366-2af4-48cf-865d-baf7964c6569 None admin] RBAC: Authorizing `identity:get_project(project_id=32866849f2c3432bb88295c8bab0bfc3)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:19.001508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3e366-2af4-48cf-865d-baf7964c6569 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:19.003191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 566/1145] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:28:18 2022] GET /identity/v3/projects/32866849f2c3432bb88295c8bab0bfc3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:19.009109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329fdbd-d4b5-4168-96f0-a2029e2e0898 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:19.020078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:19.105521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329fdbd-d4b5-4168-96f0-a2029e2e0898 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:19.138514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffee7e6-6ebc-40bf-839f-dd16cbbc512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:19.139154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffee7e6-6ebc-40bf-839f-dd16cbbc512e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:19.139436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffee7e6-6ebc-40bf-839f-dd16cbbc512e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:19.139711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffee7e6-6ebc-40bf-839f-dd16cbbc512e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:19.140619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffee7e6-6ebc-40bf-839f-dd16cbbc512e None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=32866849f2c3432bb88295c8bab0bfc3, user.id=7e8bbf2355044615b949799eb9b6b3cb) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:19.140938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffee7e6-6ebc-40bf-839f-dd16cbbc512e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:19.142354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffee7e6-6ebc-40bf-839f-dd16cbbc512e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:19.147765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 580/1146] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:28:19 2022] GET /identity/v3/role_assignments?user.id=7e8bbf2355044615b949799eb9b6b3cb&scope.project.id=32866849f2c3432bb88295c8bab0bfc3&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:21.322988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602d12-a4ea-4fce-9683-fc2c7663846c None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:21.323525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602d12-a4ea-4fce-9683-fc2c7663846c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:21.323525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602d12-a4ea-4fce-9683-fc2c7663846c None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:21.324988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 567/1147] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:21.330113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db07da-d34f-4e5c-bdd8-86ced8ed5548 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:21.330544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db07da-d34f-4e5c-bdd8-86ced8ed5548 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:21.330727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db07da-d34f-4e5c-bdd8-86ced8ed5548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:21.347534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c2db07da-d34f-4e5c-bdd8-86ced8ed5548 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:21.348741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c2db07da-d34f-4e5c-bdd8-86ced8ed5548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:21.412125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 581/1148] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:21.435044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24602d12-a4ea-4fce-9683-fc2c7663846c None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:21.533566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24602d12-a4ea-4fce-9683-fc2c7663846c None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:21.547703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:21.567300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210709d-5aa3-49da-86da-276bd8e61876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:21.568083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210709d-5aa3-49da-86da-276bd8e61876 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:21.568406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210709d-5aa3-49da-86da-276bd8e61876 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:21.568687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210709d-5aa3-49da-86da-276bd8e61876 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:21.578434 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210709d-5aa3-49da-86da-276bd8e61876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-5210709d-5aa3-49da-86da-276bd8e61876 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:28:21.586766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:28:21.587840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:28:21.588881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 568/1149] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:28:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:28:21.595563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db07da-d34f-4e5c-bdd8-86ced8ed5548 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:21.597757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:21.692857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db07da-d34f-4e5c-bdd8-86ced8ed5548 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:21.724793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03fb6b-19e7-4e99-8a49-7710b4d408c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:21.725454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03fb6b-19e7-4e99-8a49-7710b4d408c9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:21.725731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03fb6b-19e7-4e99-8a49-7710b4d408c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:21.726003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03fb6b-19e7-4e99-8a49-7710b4d408c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:21.726730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03fb6b-19e7-4e99-8a49-7710b4d408c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:21.727031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03fb6b-19e7-4e99-8a49-7710b4d408c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:21.728413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03fb6b-19e7-4e99-8a49-7710b4d408c9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:21.736986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 582/1150] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:28:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:21.742984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210709d-5aa3-49da-86da-276bd8e61876 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:21.839984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210709d-5aa3-49da-86da-276bd8e61876 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:21.872262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69810ad-7299-4cd2-9839-dd82caabebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:21.873143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69810ad-7299-4cd2-9839-dd82caabebe2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:21.873425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69810ad-7299-4cd2-9839-dd82caabebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:21.873696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69810ad-7299-4cd2-9839-dd82caabebe2 None admin] PATH_INFO: `/v3/users/7e8bbf2355044615b949799eb9b6b3cb` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:21.875443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69810ad-7299-4cd2-9839-dd82caabebe2 None admin] RBAC: Authorizing `identity:get_user(user_id=7e8bbf2355044615b949799eb9b6b3cb)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:21.877029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69810ad-7299-4cd2-9839-dd82caabebe2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:21.878651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 569/1151] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:21 2022] GET /identity/v3/users/7e8bbf2355044615b949799eb9b6b3cb => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:21.884609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03fb6b-19e7-4e99-8a49-7710b4d408c9 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:21.945665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:21.983081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03fb6b-19e7-4e99-8a49-7710b4d408c9 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:22.015976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b825-4b0d-433f-b443-bb8f5e8e6494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:22.016850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b825-4b0d-433f-b443-bb8f5e8e6494 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:22.017129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b825-4b0d-433f-b443-bb8f5e8e6494 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:22.017402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b825-4b0d-433f-b443-bb8f5e8e6494 None admin] PATH_INFO: `/v3/projects/32866849f2c3432bb88295c8bab0bfc3` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:22.018557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491b825-4b0d-433f-b443-bb8f5e8e6494 None admin] RBAC: Authorizing `identity:get_project(project_id=32866849f2c3432bb88295c8bab0bfc3)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:22.019981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491b825-4b0d-433f-b443-bb8f5e8e6494 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:22.021666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 583/1152] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:28:21 2022] GET /identity/v3/projects/32866849f2c3432bb88295c8bab0bfc3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:22.027472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69810ad-7299-4cd2-9839-dd82caabebe2 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:22.071322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:22.127970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69810ad-7299-4cd2-9839-dd82caabebe2 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:22.161323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c8ac8-34e5-4255-95c7-4a8e48fecacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:22.162195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8ac8-34e5-4255-95c7-4a8e48fecacf None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:22.162480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8ac8-34e5-4255-95c7-4a8e48fecacf None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:22.162760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8ac8-34e5-4255-95c7-4a8e48fecacf None admin] PATH_INFO: `/v3/projects/32866849f2c3432bb88295c8bab0bfc3/users/7e8bbf2355044615b949799eb9b6b3cb/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:22.164732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c8ac8-34e5-4255-95c7-4a8e48fecacf None admin] RBAC: Authorizing `identity:create_grant(project_id=32866849f2c3432bb88295c8bab0bfc3, user_id=7e8bbf2355044615b949799eb9b6b3cb, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:22.166167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c8ac8-34e5-4255-95c7-4a8e48fecacf None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:22.255861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 570/1153] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:28:22 2022] PUT /identity/v3/projects/32866849f2c3432bb88295c8bab0bfc3/users/7e8bbf2355044615b949799eb9b6b3cb/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:28:24.483430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115afda-b06f-4b05-931e-91a7cb14b1d9 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:24.484019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115afda-b06f-4b05-931e-91a7cb14b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:24.484019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115afda-b06f-4b05-931e-91a7cb14b1d9 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:24.485921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 584/1154] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:24.491252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf6d11-f235-4c8f-bba0-964112a3b8f6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:24.491655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf6d11-f235-4c8f-bba0-964112a3b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:24.491810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf6d11-f235-4c8f-bba0-964112a3b8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:24.508760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a9bf6d11-f235-4c8f-bba0-964112a3b8f6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:24.509938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a9bf6d11-f235-4c8f-bba0-964112a3b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:24.575068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 571/1155] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:24.599644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115afda-b06f-4b05-931e-91a7cb14b1d9 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:24.698992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115afda-b06f-4b05-931e-91a7cb14b1d9 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:24.727705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:24.732460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930a4b9-af01-4b6f-83dc-1a55c5b1db94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:24.733245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930a4b9-af01-4b6f-83dc-1a55c5b1db94 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:24.733575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930a4b9-af01-4b6f-83dc-1a55c5b1db94 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:24.733907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930a4b9-af01-4b6f-83dc-1a55c5b1db94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:24.743684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930a4b9-af01-4b6f-83dc-1a55c5b1db94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-f930a4b9-af01-4b6f-83dc-1a55c5b1db94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:28:24.751363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:28:24.757720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:28:24.758594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 585/1156] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:28:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:28:24.759307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf6d11-f235-4c8f-bba0-964112a3b8f6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:24.789708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:24.856373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf6d11-f235-4c8f-bba0-964112a3b8f6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:24.892583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b128dc-31bc-4149-9606-3fb145755b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:24.893259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b128dc-31bc-4149-9606-3fb145755b6d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:24.893536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b128dc-31bc-4149-9606-3fb145755b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:24.893805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b128dc-31bc-4149-9606-3fb145755b6d None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:24.894539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b128dc-31bc-4149-9606-3fb145755b6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:24.894839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b128dc-31bc-4149-9606-3fb145755b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:24.896197 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b128dc-31bc-4149-9606-3fb145755b6d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:24.904193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 572/1157] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:24.910612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930a4b9-af01-4b6f-83dc-1a55c5b1db94 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:25.016522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930a4b9-af01-4b6f-83dc-1a55c5b1db94 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:25.050711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84102ee9-94ea-444f-b7aa-1ca6068a945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:25.051580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84102ee9-94ea-444f-b7aa-1ca6068a945b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:25.051866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84102ee9-94ea-444f-b7aa-1ca6068a945b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:25.052146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84102ee9-94ea-444f-b7aa-1ca6068a945b None admin] PATH_INFO: `/v3/users/7e8bbf2355044615b949799eb9b6b3cb` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:25.053372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84102ee9-94ea-444f-b7aa-1ca6068a945b None admin] RBAC: Authorizing `identity:get_user(user_id=7e8bbf2355044615b949799eb9b6b3cb)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:25.054808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84102ee9-94ea-444f-b7aa-1ca6068a945b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:25.056471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 586/1158] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:24 2022] GET /identity/v3/users/7e8bbf2355044615b949799eb9b6b3cb => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:25.062456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b128dc-31bc-4149-9606-3fb145755b6d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:25.153498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:25.160807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b128dc-31bc-4149-9606-3fb145755b6d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:25.193774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873b49a-d33e-4580-bd66-8524c9332cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:25.194418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873b49a-d33e-4580-bd66-8524c9332cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:25.194704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873b49a-d33e-4580-bd66-8524c9332cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:25.194982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873b49a-d33e-4580-bd66-8524c9332cc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:25.260374 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873b49a-d33e-4580-bd66-8524c9332cc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:25.262075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873b49a-d33e-4580-bd66-8524c9332cc6 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:25.352743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:25.361270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 573/1159] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:28:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:28:25.370731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84102ee9-94ea-444f-b7aa-1ca6068a945b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:25.426058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:25.466178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84102ee9-94ea-444f-b7aa-1ca6068a945b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:25.498757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c535f-a5a6-491c-b685-5b80e0175c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:25.500157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c535f-a5a6-491c-b685-5b80e0175c89 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:25.500469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c535f-a5a6-491c-b685-5b80e0175c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:25.500747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c535f-a5a6-491c-b685-5b80e0175c89 None admin] PATH_INFO: `/v3/projects/32866849f2c3432bb88295c8bab0bfc3` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:25.501920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c535f-a5a6-491c-b685-5b80e0175c89 None admin] RBAC: Authorizing `identity:get_project(project_id=32866849f2c3432bb88295c8bab0bfc3)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:25.503352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c535f-a5a6-491c-b685-5b80e0175c89 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:25.505066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 587/1160] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:28:25 2022] GET /identity/v3/projects/32866849f2c3432bb88295c8bab0bfc3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:25.511129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873b49a-d33e-4580-bd66-8524c9332cc6 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:25.606861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873b49a-d33e-4580-bd66-8524c9332cc6 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:25.640663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f42de-e79e-448a-bf23-88219111f3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:25.641296 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f42de-e79e-448a-bf23-88219111f3ff None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:25.641574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f42de-e79e-448a-bf23-88219111f3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:25.641844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f42de-e79e-448a-bf23-88219111f3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:25.642653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f42de-e79e-448a-bf23-88219111f3ff None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=32866849f2c3432bb88295c8bab0bfc3, user.id=7e8bbf2355044615b949799eb9b6b3cb) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:25.642960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f42de-e79e-448a-bf23-88219111f3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:25.644403 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f42de-e79e-448a-bf23-88219111f3ff None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:25.650037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 574/1161] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:28:25 2022] GET /identity/v3/role_assignments?user.id=7e8bbf2355044615b949799eb9b6b3cb&scope.project.id=32866849f2c3432bb88295c8bab0bfc3&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:27.834008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5e18-4dc9-48c4-9895-fac7e546e399 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:27.834563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5e18-4dc9-48c4-9895-fac7e546e399 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:27.834563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5e18-4dc9-48c4-9895-fac7e546e399 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:27.835913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 588/1162] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:27.841223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07721c7-3197-4848-9db2-9a35671bc8be None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:27.841646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07721c7-3197-4848-9db2-9a35671bc8be None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:27.841763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07721c7-3197-4848-9db2-9a35671bc8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:27.859465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d07721c7-3197-4848-9db2-9a35671bc8be None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:27.860677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d07721c7-3197-4848-9db2-9a35671bc8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:27.912189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:27.925510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 575/1163] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:27.947715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5e18-4dc9-48c4-9895-fac7e546e399 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:28.048421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5e18-4dc9-48c4-9895-fac7e546e399 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:28.073414 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:28.081119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2912f8-135a-4291-8097-22dae549f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:28.085634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2912f8-135a-4291-8097-22dae549f8ef None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:28.085634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2912f8-135a-4291-8097-22dae549f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:28.085634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2912f8-135a-4291-8097-22dae549f8ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:28.147620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2912f8-135a-4291-8097-22dae549f8ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:28.149090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2912f8-135a-4291-8097-22dae549f8ef None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:28.245283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 589/1164] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:28:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:28:28.251253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07721c7-3197-4848-9db2-9a35671bc8be None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:28.348195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07721c7-3197-4848-9db2-9a35671bc8be None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:28.380236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b474c4-5c1f-481f-bfaf-d9796a65a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:28.381060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b474c4-5c1f-481f-bfaf-d9796a65a262 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:28.381347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b474c4-5c1f-481f-bfaf-d9796a65a262 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:28.381652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b474c4-5c1f-481f-bfaf-d9796a65a262 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:28.388445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b474c4-5c1f-481f-bfaf-d9796a65a262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:28.390425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b474c4-5c1f-481f-bfaf-d9796a65a262 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-48b474c4-5c1f-481f-bfaf-d9796a65a262 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:28:28.404370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:28:28.405978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:28:28.407827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 576/1165] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:28:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:28:28.412378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2912f8-135a-4291-8097-22dae549f8ef None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:28.443425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:28.514547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2912f8-135a-4291-8097-22dae549f8ef None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:28.548340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598c26-c645-4c01-aa1e-47cee1e1ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:28.549000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598c26-c645-4c01-aa1e-47cee1e1ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:28.549284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598c26-c645-4c01-aa1e-47cee1e1ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:28.549559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598c26-c645-4c01-aa1e-47cee1e1ccf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:28.550279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0598c26-c645-4c01-aa1e-47cee1e1ccf3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:28.550585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0598c26-c645-4c01-aa1e-47cee1e1ccf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:28.551953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0598c26-c645-4c01-aa1e-47cee1e1ccf3 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:28.558931 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 590/1166] 10.222.0.74 () {56 vars in 1115 bytes} [Mon May 23 16:28:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:30.745062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0adcb5-68d1-4b31-b022-42f9e162ce3e None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:30.745618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0adcb5-68d1-4b31-b022-42f9e162ce3e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:30.745618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0adcb5-68d1-4b31-b022-42f9e162ce3e None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:30.746986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 577/1167] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:30.752941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517594b5-ad9b-4f37-a653-b1eb4c5796bc None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:30.753376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517594b5-ad9b-4f37-a653-b1eb4c5796bc None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:30.753504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517594b5-ad9b-4f37-a653-b1eb4c5796bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:30.771501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-517594b5-ad9b-4f37-a653-b1eb4c5796bc None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:30.772724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-517594b5-ad9b-4f37-a653-b1eb4c5796bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:30.845551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 591/1168] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:30.867823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0adcb5-68d1-4b31-b022-42f9e162ce3e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:30.918007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:30.969676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0adcb5-68d1-4b31-b022-42f9e162ce3e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:31.002445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659377d2-5a71-4189-af6c-e9a0339802f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:31.003038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659377d2-5a71-4189-af6c-e9a0339802f0 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:31.003326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659377d2-5a71-4189-af6c-e9a0339802f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:31.003603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659377d2-5a71-4189-af6c-e9a0339802f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:31.004361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659377d2-5a71-4189-af6c-e9a0339802f0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:31.005735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659377d2-5a71-4189-af6c-e9a0339802f0 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:31.093871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 578/1169] 10.222.0.74 () {60 vars in 1138 bytes} [Mon May 23 16:28:30 2022] POST /identity/v3/domains => generated 267 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:28:33.283528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a4f47-cf04-4315-bf61-362781a748a6 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:33.284030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a4f47-cf04-4315-bf61-362781a748a6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:33.284135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a4f47-cf04-4315-bf61-362781a748a6 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:33.285469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 592/1170] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:33.290558 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d0ffa-a4d5-4a34-b713-f5748590e1c4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:33.290940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d0ffa-a4d5-4a34-b713-f5748590e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:33.291108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d0ffa-a4d5-4a34-b713-f5748590e1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:33.307464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-ec2d0ffa-a4d5-4a34-b713-f5748590e1c4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:33.308656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ec2d0ffa-a4d5-4a34-b713-f5748590e1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:33.373055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 579/1171] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:33.397034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a4f47-cf04-4315-bf61-362781a748a6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:33.420459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:33.496924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a4f47-cf04-4315-bf61-362781a748a6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:33.530437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f6eed-61be-4362-ac44-6913d4576c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:33.531362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f6eed-61be-4362-ac44-6913d4576c74 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:33.531647 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f6eed-61be-4362-ac44-6913d4576c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:33.531924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f6eed-61be-4362-ac44-6913d4576c74 None admin] PATH_INFO: `/v3/domains/f1e2a2d543ff406090c2d904b3fa0ed5` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:33.541897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f6eed-61be-4362-ac44-6913d4576c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f1e2a2d543ff406090c2d904b3fa0ed5)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:33.543338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f6eed-61be-4362-ac44-6913d4576c74 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:33.545041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 593/1172] 10.222.0.74 () {56 vars in 1183 bytes} [Mon May 23 16:28:33 2022] GET /identity/v3/domains/f1e2a2d543ff406090c2d904b3fa0ed5 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:33.551230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d0ffa-a4d5-4a34-b713-f5748590e1c4 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:33.588884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:33.646240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d0ffa-a4d5-4a34-b713-f5748590e1c4 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:33.680096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a099-b1c0-4496-9276-465fc36a5dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:33.681031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a099-b1c0-4496-9276-465fc36a5dd4 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:33.681532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a099-b1c0-4496-9276-465fc36a5dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:33.682019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a099-b1c0-4496-9276-465fc36a5dd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:33.683122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0a099-b1c0-4496-9276-465fc36a5dd4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:33.684578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0a099-b1c0-4496-9276-465fc36a5dd4 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:33.790181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 580/1173] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:28:33 2022] POST /identity/v3/projects => generated 361 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:28:35.981947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f6618-882b-4843-bbe3-dac5b36dcd5a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:35.982505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f6618-882b-4843-bbe3-dac5b36dcd5a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:35.982505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f6618-882b-4843-bbe3-dac5b36dcd5a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:35.984695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 594/1174] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:35.989823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b4694-a96e-4b5c-b83d-2dcfea934aec None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:35.990235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b4694-a96e-4b5c-b83d-2dcfea934aec None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:35.990380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b4694-a96e-4b5c-b83d-2dcfea934aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:36.007167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-259b4694-a96e-4b5c-b83d-2dcfea934aec None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:36.008423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-259b4694-a96e-4b5c-b83d-2dcfea934aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:36.071747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 581/1175] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:36.096511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f6618-882b-4843-bbe3-dac5b36dcd5a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:36.176803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:36.195245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f6618-882b-4843-bbe3-dac5b36dcd5a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:36.230664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401558ce-7f49-4458-8e50-145b451d5251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:36.231515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401558ce-7f49-4458-8e50-145b451d5251 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:36.231793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401558ce-7f49-4458-8e50-145b451d5251 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:36.232110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401558ce-7f49-4458-8e50-145b451d5251 None admin] PATH_INFO: `/v3/domains/f1e2a2d543ff406090c2d904b3fa0ed5` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:36.233335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401558ce-7f49-4458-8e50-145b451d5251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f1e2a2d543ff406090c2d904b3fa0ed5)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:36.234750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401558ce-7f49-4458-8e50-145b451d5251 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:36.236354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 595/1176] 10.222.0.74 () {56 vars in 1183 bytes} [Mon May 23 16:28:36 2022] GET /identity/v3/domains/f1e2a2d543ff406090c2d904b3fa0ed5 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:36.242158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b4694-a96e-4b5c-b83d-2dcfea934aec None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:36.263155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:36.338669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b4694-a96e-4b5c-b83d-2dcfea934aec None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:36.373324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90025f0a-2aa0-42e3-8ae6-113f4bd32ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:36.374513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025f0a-2aa0-42e3-8ae6-113f4bd32ff6 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:36.374793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025f0a-2aa0-42e3-8ae6-113f4bd32ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:36.375063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025f0a-2aa0-42e3-8ae6-113f4bd32ff6 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:36.375768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90025f0a-2aa0-42e3-8ae6-113f4bd32ff6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:36.377219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90025f0a-2aa0-42e3-8ae6-113f4bd32ff6 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:36.463595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 582/1177] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:28:36 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:28:38.721790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf32c-d7b1-44f0-870f-74bf7684a0fe None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:38.722441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf32c-d7b1-44f0-870f-74bf7684a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:38.722441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf32c-d7b1-44f0-870f-74bf7684a0fe None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:38.723666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 596/1178] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:38.729127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef3c3-7091-43e1-a8b9-b6bd23249c6b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:38.729520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef3c3-7091-43e1-a8b9-b6bd23249c6b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:38.729688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef3c3-7091-43e1-a8b9-b6bd23249c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:38.746246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-56aef3c3-7091-43e1-a8b9-b6bd23249c6b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:38.747466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-56aef3c3-7091-43e1-a8b9-b6bd23249c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:38.813436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 583/1179] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:38.836339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebf32c-d7b1-44f0-870f-74bf7684a0fe None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:38.933807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebf32c-d7b1-44f0-870f-74bf7684a0fe None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:38.965732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6661e5-87c6-4e6c-9825-be306b4b2b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:38.966498 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6661e5-87c6-4e6c-9825-be306b4b2b5f None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:38.966774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6661e5-87c6-4e6c-9825-be306b4b2b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:38.967040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6661e5-87c6-4e6c-9825-be306b4b2b5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:38.976919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6661e5-87c6-4e6c-9825-be306b4b2b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-7b6661e5-87c6-4e6c-9825-be306b4b2b5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:28:38.988966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:28:38.990081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:28:38.991147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 597/1180] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:28:38.996057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aef3c3-7091-43e1-a8b9-b6bd23249c6b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:39.004717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:39.094484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aef3c3-7091-43e1-a8b9-b6bd23249c6b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:39.128200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce29eb7-ff48-4edf-8d99-d6f8b2fcdb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:39.128891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce29eb7-ff48-4edf-8d99-d6f8b2fcdb2f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:39.129178 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce29eb7-ff48-4edf-8d99-d6f8b2fcdb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:39.129456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce29eb7-ff48-4edf-8d99-d6f8b2fcdb2f None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:39.130202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce29eb7-ff48-4edf-8d99-d6f8b2fcdb2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:39.130602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce29eb7-ff48-4edf-8d99-d6f8b2fcdb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:39.131986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce29eb7-ff48-4edf-8d99-d6f8b2fcdb2f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:39.140166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 584/1181] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:39.145889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6661e5-87c6-4e6c-9825-be306b4b2b5f None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:39.158828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:39.243653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6661e5-87c6-4e6c-9825-be306b4b2b5f None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:39.276447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b7c39-fbfb-4c98-8024-1d2fe600c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:39.277295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b7c39-fbfb-4c98-8024-1d2fe600c127 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:39.277576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b7c39-fbfb-4c98-8024-1d2fe600c127 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:39.277848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b7c39-fbfb-4c98-8024-1d2fe600c127 None admin] PATH_INFO: `/v3/users/f012c939d08942d3bcf7b8f75288f891` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:39.290315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b7c39-fbfb-4c98-8024-1d2fe600c127 None admin] RBAC: Authorizing `identity:get_user(user_id=f012c939d08942d3bcf7b8f75288f891)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:39.291745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b7c39-fbfb-4c98-8024-1d2fe600c127 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:39.293383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 598/1182] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:39 2022] GET /identity/v3/users/f012c939d08942d3bcf7b8f75288f891 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:39.300404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce29eb7-ff48-4edf-8d99-d6f8b2fcdb2f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:39.365647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:39.399465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce29eb7-ff48-4edf-8d99-d6f8b2fcdb2f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:39.431679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0163a7-78fa-4916-85f5-b339db786375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:39.432344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0163a7-78fa-4916-85f5-b339db786375 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:39.432634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0163a7-78fa-4916-85f5-b339db786375 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:39.432915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0163a7-78fa-4916-85f5-b339db786375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:39.499005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0163a7-78fa-4916-85f5-b339db786375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:39.500405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0163a7-78fa-4916-85f5-b339db786375 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:39.562910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:39.600020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 585/1183] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:28:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:28:39.605874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b7c39-fbfb-4c98-8024-1d2fe600c127 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:39.671646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:39.703532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b7c39-fbfb-4c98-8024-1d2fe600c127 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:39.737101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb2485-4ce4-4b76-adb8-3e37f147033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:39.737946 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2485-4ce4-4b76-adb8-3e37f147033e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:39.738226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2485-4ce4-4b76-adb8-3e37f147033e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:39.738498 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2485-4ce4-4b76-adb8-3e37f147033e None admin] PATH_INFO: `/v3/projects/63fbd8d10d1b4447be019f8ec8739370` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:39.739661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb2485-4ce4-4b76-adb8-3e37f147033e None admin] RBAC: Authorizing `identity:get_project(project_id=63fbd8d10d1b4447be019f8ec8739370)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:39.741118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb2485-4ce4-4b76-adb8-3e37f147033e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:39.742784 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 599/1184] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:28:39 2022] GET /identity/v3/projects/63fbd8d10d1b4447be019f8ec8739370 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:39.749903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0163a7-78fa-4916-85f5-b339db786375 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:39.845448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0163a7-78fa-4916-85f5-b339db786375 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:39.880625 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd830b-ed59-4734-bcd1-6fa8b55ac508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:39.881262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd830b-ed59-4734-bcd1-6fa8b55ac508 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:39.881541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd830b-ed59-4734-bcd1-6fa8b55ac508 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:39.881812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd830b-ed59-4734-bcd1-6fa8b55ac508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:39.882656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd830b-ed59-4734-bcd1-6fa8b55ac508 None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=63fbd8d10d1b4447be019f8ec8739370, user.id=f012c939d08942d3bcf7b8f75288f891) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:39.882959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd830b-ed59-4734-bcd1-6fa8b55ac508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:39.884402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd830b-ed59-4734-bcd1-6fa8b55ac508 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:39.889985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 586/1185] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:28:39 2022] GET /identity/v3/role_assignments?user.id=f012c939d08942d3bcf7b8f75288f891&scope.project.id=63fbd8d10d1b4447be019f8ec8739370&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:42.053411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e998b-a330-42c6-970e-1c6312a4d4e9 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.053945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e998b-a330-42c6-970e-1c6312a4d4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.053945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e998b-a330-42c6-970e-1c6312a4d4e9 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.055312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 600/1186] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:42.061459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763fc56-47ab-49c0-8b3d-430c7bda6d50 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.061846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763fc56-47ab-49c0-8b3d-430c7bda6d50 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.062168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763fc56-47ab-49c0-8b3d-430c7bda6d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.078585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-0763fc56-47ab-49c0-8b3d-430c7bda6d50 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:42.079790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0763fc56-47ab-49c0-8b3d-430c7bda6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:42.104856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:42.146173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 587/1187] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:42.168924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e998b-a330-42c6-970e-1c6312a4d4e9 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:42.267384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e998b-a330-42c6-970e-1c6312a4d4e9 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:42.300524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d10c6-a491-45d3-ac00-7f62f0e543d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:42.301299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d10c6-a491-45d3-ac00-7f62f0e543d3 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.301577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d10c6-a491-45d3-ac00-7f62f0e543d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.301850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d10c6-a491-45d3-ac00-7f62f0e543d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.304467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:42.312257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d10c6-a491-45d3-ac00-7f62f0e543d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-1b8d10c6-a491-45d3-ac00-7f62f0e543d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:28:42.322563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:28:42.323685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:28:42.324775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 601/1188] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:28:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:28:42.327307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763fc56-47ab-49c0-8b3d-430c7bda6d50 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:42.424060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763fc56-47ab-49c0-8b3d-430c7bda6d50 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:42.456395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c006a-dcf8-4df7-aa7c-ef65cfbfb6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:42.457044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c006a-dcf8-4df7-aa7c-ef65cfbfb6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.457324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c006a-dcf8-4df7-aa7c-ef65cfbfb6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.457596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c006a-dcf8-4df7-aa7c-ef65cfbfb6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.458336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c006a-dcf8-4df7-aa7c-ef65cfbfb6b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:42.458638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c006a-dcf8-4df7-aa7c-ef65cfbfb6b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:42.459999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c006a-dcf8-4df7-aa7c-ef65cfbfb6b5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:42.468813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 588/1189] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:28:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:42.474538 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d10c6-a491-45d3-ac00-7f62f0e543d3 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:42.570326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d10c6-a491-45d3-ac00-7f62f0e543d3 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:42.602724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc2452-e515-4c2d-b5af-f9658cfbc9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:42.603572 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc2452-e515-4c2d-b5af-f9658cfbc9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.603847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc2452-e515-4c2d-b5af-f9658cfbc9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.604116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc2452-e515-4c2d-b5af-f9658cfbc9f5 None admin] PATH_INFO: `/v3/users/f012c939d08942d3bcf7b8f75288f891` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.605305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc2452-e515-4c2d-b5af-f9658cfbc9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=f012c939d08942d3bcf7b8f75288f891)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:42.606721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc2452-e515-4c2d-b5af-f9658cfbc9f5 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:42.608499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 602/1190] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:42 2022] GET /identity/v3/users/f012c939d08942d3bcf7b8f75288f891 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:42.614049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c006a-dcf8-4df7-aa7c-ef65cfbfb6b5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:42.638831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:42.712116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c006a-dcf8-4df7-aa7c-ef65cfbfb6b5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:42.745293 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b2777-8a83-494e-822e-99796987447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:42.746136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2777-8a83-494e-822e-99796987447f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.746420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2777-8a83-494e-822e-99796987447f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.746695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2777-8a83-494e-822e-99796987447f None admin] PATH_INFO: `/v3/projects/63fbd8d10d1b4447be019f8ec8739370` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.747853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b2777-8a83-494e-822e-99796987447f None admin] RBAC: Authorizing `identity:get_project(project_id=63fbd8d10d1b4447be019f8ec8739370)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:42.749360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b2777-8a83-494e-822e-99796987447f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:42.751036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 589/1191] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:28:42 2022] GET /identity/v3/projects/63fbd8d10d1b4447be019f8ec8739370 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:42.756889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc2452-e515-4c2d-b5af-f9658cfbc9f5 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:42.817862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:42.855020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc2452-e515-4c2d-b5af-f9658cfbc9f5 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:42.886921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c759-50d3-46d4-8727-e3e7857b6889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:42.887793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c759-50d3-46d4-8727-e3e7857b6889 None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.888075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c759-50d3-46d4-8727-e3e7857b6889 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.888375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c759-50d3-46d4-8727-e3e7857b6889 None admin] PATH_INFO: `/v3/projects/63fbd8d10d1b4447be019f8ec8739370/users/f012c939d08942d3bcf7b8f75288f891/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.890826 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c759-50d3-46d4-8727-e3e7857b6889 None admin] RBAC: Authorizing `identity:create_grant(project_id=63fbd8d10d1b4447be019f8ec8739370, user_id=f012c939d08942d3bcf7b8f75288f891, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:42.892249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c759-50d3-46d4-8727-e3e7857b6889 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:42.950612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 603/1192] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:28:42 2022] PUT /identity/v3/projects/63fbd8d10d1b4447be019f8ec8739370/users/f012c939d08942d3bcf7b8f75288f891/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:28:45.118415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d00b4-beb5-4368-9c22-890e850b28a5 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:45.118948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d00b4-beb5-4368-9c22-890e850b28a5 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:45.118948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d00b4-beb5-4368-9c22-890e850b28a5 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:45.120350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 590/1193] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:28:45.126274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9096f-ee74-44e0-9179-2aacea8f6586 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:45.126673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9096f-ee74-44e0-9179-2aacea8f6586 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:45.126816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9096f-ee74-44e0-9179-2aacea8f6586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:45.143479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-afe9096f-ee74-44e0-9179-2aacea8f6586 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:45.144681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-afe9096f-ee74-44e0-9179-2aacea8f6586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:45.208009 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 604/1194] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:28:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:28:45.231471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d00b4-beb5-4368-9c22-890e850b28a5 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:45.319768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:45.328838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d00b4-beb5-4368-9c22-890e850b28a5 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:45.361601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8936e8-2702-441f-8915-6d1936e6ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:45.362375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8936e8-2702-441f-8915-6d1936e6ba37 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:45.362654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8936e8-2702-441f-8915-6d1936e6ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:45.362925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8936e8-2702-441f-8915-6d1936e6ba37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:45.373001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8936e8-2702-441f-8915-6d1936e6ba37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-fe8936e8-2702-441f-8915-6d1936e6ba37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:28:45.380685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:28:45.381766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:28:45.382931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 591/1195] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:28:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:28:45.388001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9096f-ee74-44e0-9179-2aacea8f6586 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:45.440908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:45.483739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9096f-ee74-44e0-9179-2aacea8f6586 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:45.516844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa532b-6826-434e-ab58-ba2cbb90a870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:45.517513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa532b-6826-434e-ab58-ba2cbb90a870 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:45.517796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa532b-6826-434e-ab58-ba2cbb90a870 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:45.518070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa532b-6826-434e-ab58-ba2cbb90a870 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:45.518816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa532b-6826-434e-ab58-ba2cbb90a870 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:45.519124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa532b-6826-434e-ab58-ba2cbb90a870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:45.520520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa532b-6826-434e-ab58-ba2cbb90a870 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:45.528559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 605/1196] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:45.535001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8936e8-2702-441f-8915-6d1936e6ba37 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:45.631120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8936e8-2702-441f-8915-6d1936e6ba37 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:45.663683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ad78-5b32-4c03-a7f0-eb035f68aa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:45.664559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ad78-5b32-4c03-a7f0-eb035f68aa4b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:45.664841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ad78-5b32-4c03-a7f0-eb035f68aa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:45.665112 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ad78-5b32-4c03-a7f0-eb035f68aa4b None admin] PATH_INFO: `/v3/users/f012c939d08942d3bcf7b8f75288f891` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:45.666269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4ad78-5b32-4c03-a7f0-eb035f68aa4b None admin] RBAC: Authorizing `identity:get_user(user_id=f012c939d08942d3bcf7b8f75288f891)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:45.667693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4ad78-5b32-4c03-a7f0-eb035f68aa4b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:45.669323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 592/1197] 10.222.0.74 () {56 vars in 1177 bytes} [Mon May 23 16:28:45 2022] GET /identity/v3/users/f012c939d08942d3bcf7b8f75288f891 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:45.674937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa532b-6826-434e-ab58-ba2cbb90a870 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:45.772509 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa532b-6826-434e-ab58-ba2cbb90a870 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:45.788433 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:45.805479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec0b20-690b-460c-a91a-b89304748f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:45.806118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec0b20-690b-460c-a91a-b89304748f8d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:45.806396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec0b20-690b-460c-a91a-b89304748f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:45.806700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec0b20-690b-460c-a91a-b89304748f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:45.871496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec0b20-690b-460c-a91a-b89304748f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:45.872950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec0b20-690b-460c-a91a-b89304748f8d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:45.966421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 606/1198] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:28:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:28:45.973353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ad78-5b32-4c03-a7f0-eb035f68aa4b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:45.996505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:46.072314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ad78-5b32-4c03-a7f0-eb035f68aa4b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:46.105801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981d498-ebdb-4ebf-a176-15f4e5cba58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:46.106649 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d498-ebdb-4ebf-a176-15f4e5cba58b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:46.106935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d498-ebdb-4ebf-a176-15f4e5cba58b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:46.107209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d498-ebdb-4ebf-a176-15f4e5cba58b None admin] PATH_INFO: `/v3/projects/63fbd8d10d1b4447be019f8ec8739370` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:46.109076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981d498-ebdb-4ebf-a176-15f4e5cba58b None admin] RBAC: Authorizing `identity:get_project(project_id=63fbd8d10d1b4447be019f8ec8739370)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:46.110507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981d498-ebdb-4ebf-a176-15f4e5cba58b None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:46.112215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 593/1199] 10.222.0.74 () {56 vars in 1186 bytes} [Mon May 23 16:28:45 2022] GET /identity/v3/projects/63fbd8d10d1b4447be019f8ec8739370 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:46.118367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec0b20-690b-460c-a91a-b89304748f8d None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:46.139076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:46.218794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec0b20-690b-460c-a91a-b89304748f8d None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:46.252733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829be82-8d56-42f5-9b11-793e805e1eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:46.253380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829be82-8d56-42f5-9b11-793e805e1eea None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:46.253661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829be82-8d56-42f5-9b11-793e805e1eea None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:46.253938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829be82-8d56-42f5-9b11-793e805e1eea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:46.254754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829be82-8d56-42f5-9b11-793e805e1eea None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=63fbd8d10d1b4447be019f8ec8739370, user.id=f012c939d08942d3bcf7b8f75288f891) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:46.255065 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829be82-8d56-42f5-9b11-793e805e1eea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:46.256517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829be82-8d56-42f5-9b11-793e805e1eea None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:46.262378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 607/1200] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:28:46 2022] GET /identity/v3/role_assignments?user.id=f012c939d08942d3bcf7b8f75288f891&scope.project.id=63fbd8d10d1b4447be019f8ec8739370&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:56.101676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=56 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:56.259564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=60 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:02.102008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbcd7b-3200-465e-a14e-8f2565eadf9d None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:02.102630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbcd7b-3200-465e-a14e-8f2565eadf9d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:02.102630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbcd7b-3200-465e-a14e-8f2565eadf9d None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:02.103921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 594/1201] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:02.109163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b3e5d-46d4-4000-88a4-4aba41dd990d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:02.109579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b3e5d-46d4-4000-88a4-4aba41dd990d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:02.109736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b3e5d-46d4-4000-88a4-4aba41dd990d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:02.127484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4c4b3e5d-46d4-4000-88a4-4aba41dd990d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:02.132058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4c4b3e5d-46d4-4000-88a4-4aba41dd990d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:02.195363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 608/1202] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 16:30:02.220348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbcd7b-3200-465e-a14e-8f2565eadf9d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:02.322814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbcd7b-3200-465e-a14e-8f2565eadf9d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:02.356421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c6aaf-d4bd-466b-ad09-649dfb17e94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:02.357131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6aaf-d4bd-466b-ad09-649dfb17e94d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:02.357409 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6aaf-d4bd-466b-ad09-649dfb17e94d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:02.357679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6aaf-d4bd-466b-ad09-649dfb17e94d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:02.367642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c6aaf-d4bd-466b-ad09-649dfb17e94d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:02.370370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c6aaf-d4bd-466b-ad09-649dfb17e94d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-c69c6aaf-d4bd-466b-ad09-649dfb17e94d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:02.386564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:02.387679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:02.389132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:02.389132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:02.389132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:02.389132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:02.389132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 595/1203] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:02.394140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b3e5d-46d4-4000-88a4-4aba41dd990d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:02.493494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b3e5d-46d4-4000-88a4-4aba41dd990d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:02.522107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:02.527622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d96e17-790a-4800-af66-8b33a7b03ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:02.528357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d96e17-790a-4800-af66-8b33a7b03ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:02.528639 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d96e17-790a-4800-af66-8b33a7b03ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:02.528911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d96e17-790a-4800-af66-8b33a7b03ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:02.529621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d96e17-790a-4800-af66-8b33a7b03ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:02.529926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d96e17-790a-4800-af66-8b33a7b03ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:02.531876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d96e17-790a-4800-af66-8b33a7b03ea4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:02.542707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 609/1204] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:02.548834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c6aaf-d4bd-466b-ad09-649dfb17e94d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:02.601114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:02.645906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c6aaf-d4bd-466b-ad09-649dfb17e94d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:02.679357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692416d7-f3d1-45ea-bb79-5587f053408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:02.680018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692416d7-f3d1-45ea-bb79-5587f053408d None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:02.680324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692416d7-f3d1-45ea-bb79-5587f053408d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:02.680608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692416d7-f3d1-45ea-bb79-5587f053408d None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:02.681322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692416d7-f3d1-45ea-bb79-5587f053408d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:02.682758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692416d7-f3d1-45ea-bb79-5587f053408d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:02.808895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 596/1205] 10.222.0.74 () {60 vars in 1132 bytes} [Mon May 23 16:30:02 2022] POST /identity/v3/users => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:30:05.071178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a7a6d-2b60-4f98-b565-21f11c4f88c7 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:05.071771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a7a6d-2b60-4f98-b565-21f11c4f88c7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:05.071771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a7a6d-2b60-4f98-b565-21f11c4f88c7 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:05.073103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 610/1206] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:05.078516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b50aa7-0411-412b-a2fa-f7f1e6c947e4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:05.092887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b50aa7-0411-412b-a2fa-f7f1e6c947e4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:05.092887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b50aa7-0411-412b-a2fa-f7f1e6c947e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:05.096106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-18b50aa7-0411-412b-a2fa-f7f1e6c947e4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:05.097323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-18b50aa7-0411-412b-a2fa-f7f1e6c947e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:05.163145 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 597/1207] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:05.187292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a7a6d-2b60-4f98-b565-21f11c4f88c7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:05.288586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a7a6d-2b60-4f98-b565-21f11c4f88c7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:05.322163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351e62-4260-4bcb-9602-c0808e992a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:05.322883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351e62-4260-4bcb-9602-c0808e992a32 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:05.323171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351e62-4260-4bcb-9602-c0808e992a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:05.323446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351e62-4260-4bcb-9602-c0808e992a32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:05.334045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351e62-4260-4bcb-9602-c0808e992a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-65351e62-4260-4bcb-9602-c0808e992a32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:30:05.341767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:05.343588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:05.344665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 611/1208] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:30:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:05.349658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b50aa7-0411-412b-a2fa-f7f1e6c947e4 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:05.388596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:05.446370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b50aa7-0411-412b-a2fa-f7f1e6c947e4 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:05.480430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841c2b5-e988-4b78-96a4-7fdce2581636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:05.481086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841c2b5-e988-4b78-96a4-7fdce2581636 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:05.481366 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841c2b5-e988-4b78-96a4-7fdce2581636 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:05.481637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841c2b5-e988-4b78-96a4-7fdce2581636 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:05.482370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841c2b5-e988-4b78-96a4-7fdce2581636 None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:05.482670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841c2b5-e988-4b78-96a4-7fdce2581636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:05.484388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841c2b5-e988-4b78-96a4-7fdce2581636 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:05.492230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 598/1209] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:30:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:05.505864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351e62-4260-4bcb-9602-c0808e992a32 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:05.548207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:05.596517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351e62-4260-4bcb-9602-c0808e992a32 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:05.628733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d09c34-f5c9-4092-b744-d9cba5b6c447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:05.629516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d09c34-f5c9-4092-b744-d9cba5b6c447 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:05.629795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d09c34-f5c9-4092-b744-d9cba5b6c447 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:05.630066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d09c34-f5c9-4092-b744-d9cba5b6c447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:05.640830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d09c34-f5c9-4092-b744-d9cba5b6c447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:05.642331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d09c34-f5c9-4092-b744-d9cba5b6c447 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-54d09c34-f5c9-4092-b744-d9cba5b6c447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:05.660192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:05.661287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:05.662632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:05.662632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:05.662632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:05.662632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:05.662632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 612/1210] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:05.667146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841c2b5-e988-4b78-96a4-7fdce2581636 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:05.765303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:05.768105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841c2b5-e988-4b78-96a4-7fdce2581636 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:05.799833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165fcb7-5bf0-4bd0-8935-4edec25fed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:05.800506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fcb7-5bf0-4bd0-8935-4edec25fed47 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:05.801751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fcb7-5bf0-4bd0-8935-4edec25fed47 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:05.801751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fcb7-5bf0-4bd0-8935-4edec25fed47 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:05.801751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165fcb7-5bf0-4bd0-8935-4edec25fed47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:05.802125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165fcb7-5bf0-4bd0-8935-4edec25fed47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:05.803362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165fcb7-5bf0-4bd0-8935-4edec25fed47 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:05.814643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 599/1211] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:30:05.820590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d09c34-f5c9-4092-b744-d9cba5b6c447 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:05.929250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d09c34-f5c9-4092-b744-d9cba5b6c447 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:05.930672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:05.963141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1e08c-7c25-408d-8835-ffba4ded8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:05.963935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1e08c-7c25-408d-8835-ffba4ded8135 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:05.964226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1e08c-7c25-408d-8835-ffba4ded8135 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:05.964534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1e08c-7c25-408d-8835-ffba4ded8135 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:05.972137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1e08c-7c25-408d-8835-ffba4ded8135 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:05.973614 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1e08c-7c25-408d-8835-ffba4ded8135 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-6cd1e08c-7c25-408d-8835-ffba4ded8135 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:30:05.987812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:05.989006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:05.997730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 613/1212] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:05.998984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165fcb7-5bf0-4bd0-8935-4edec25fed47 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:06.094089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165fcb7-5bf0-4bd0-8935-4edec25fed47 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:06.127741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb534e-d425-437b-93a5-f9c05b0b5108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:06.128442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb534e-d425-437b-93a5-f9c05b0b5108 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:06.128722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb534e-d425-437b-93a5-f9c05b0b5108 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:06.128993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb534e-d425-437b-93a5-f9c05b0b5108 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:06.129812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb534e-d425-437b-93a5-f9c05b0b5108 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:06.130114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb534e-d425-437b-93a5-f9c05b0b5108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:06.131795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb534e-d425-437b-93a5-f9c05b0b5108 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:06.148801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 600/1213] 10.222.0.74 () {56 vars in 1143 bytes} [Mon May 23 16:30:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:06.154704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1e08c-7c25-408d-8835-ffba4ded8135 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:06.260190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1e08c-7c25-408d-8835-ffba4ded8135 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:06.292672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a7a6-31fd-46bf-a25f-6cae0919e724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:06.293359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a7a6-31fd-46bf-a25f-6cae0919e724 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:06.293701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a7a6-31fd-46bf-a25f-6cae0919e724 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:06.293985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a7a6-31fd-46bf-a25f-6cae0919e724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:06.325700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:06.362990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1a7a6-31fd-46bf-a25f-6cae0919e724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:06.364469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1a7a6-31fd-46bf-a25f-6cae0919e724 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:06.460505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 614/1214] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:30:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:30:06.466645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb534e-d425-437b-93a5-f9c05b0b5108 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:06.486309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:06.565047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb534e-d425-437b-93a5-f9c05b0b5108 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:06.597826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241732a-dfe2-40c9-92c5-2270756f9115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:06.598609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241732a-dfe2-40c9-92c5-2270756f9115 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:06.598896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241732a-dfe2-40c9-92c5-2270756f9115 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:06.599175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241732a-dfe2-40c9-92c5-2270756f9115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:06.610282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241732a-dfe2-40c9-92c5-2270756f9115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:06.611737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241732a-dfe2-40c9-92c5-2270756f9115 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-5241732a-dfe2-40c9-92c5-2270756f9115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:06.629260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:06.639061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:06.640311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:06.640311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:06.640311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:06.640311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:06.640311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 601/1215] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:06.640618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a7a6-31fd-46bf-a25f-6cae0919e724 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:06.699168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:06.739319 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a7a6-31fd-46bf-a25f-6cae0919e724 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:06.773906 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fe818-6a3f-4b25-80aa-3ec775ebc6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:06.774570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe818-6a3f-4b25-80aa-3ec775ebc6de None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:06.774860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe818-6a3f-4b25-80aa-3ec775ebc6de None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:06.775138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe818-6a3f-4b25-80aa-3ec775ebc6de None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:06.775857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fe818-6a3f-4b25-80aa-3ec775ebc6de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:06.776165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fe818-6a3f-4b25-80aa-3ec775ebc6de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:06.777600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fe818-6a3f-4b25-80aa-3ec775ebc6de None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:06.790237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 615/1216] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:06.797134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241732a-dfe2-40c9-92c5-2270756f9115 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:06.867505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:06.897416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241732a-dfe2-40c9-92c5-2270756f9115 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:06.931363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f3b0e-815b-4bd9-8686-8dbabff247d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:06.932150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f3b0e-815b-4bd9-8686-8dbabff247d5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:06.932468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f3b0e-815b-4bd9-8686-8dbabff247d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:06.932750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f3b0e-815b-4bd9-8686-8dbabff247d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:06.939960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f3b0e-815b-4bd9-8686-8dbabff247d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:06.941440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f3b0e-815b-4bd9-8686-8dbabff247d5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-d29f3b0e-815b-4bd9-8686-8dbabff247d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:30:06.955000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:06.958394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:06.959323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:30:06.959323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:30:06.959323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:30:06.959323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:30:06.959323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:30:06.959323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:30:06.959323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:06.959323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:06.959323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 602/1217] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:30:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:06.962055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fe818-6a3f-4b25-80aa-3ec775ebc6de None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:07.060382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fe818-6a3f-4b25-80aa-3ec775ebc6de None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:07.083148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:07.094615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2390c1-712a-4620-a8ef-bab10f3915d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:07.095274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2390c1-712a-4620-a8ef-bab10f3915d6 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:07.095559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2390c1-712a-4620-a8ef-bab10f3915d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:07.095835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2390c1-712a-4620-a8ef-bab10f3915d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:07.096648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2390c1-712a-4620-a8ef-bab10f3915d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:07.096962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2390c1-712a-4620-a8ef-bab10f3915d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:07.098404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2390c1-712a-4620-a8ef-bab10f3915d6 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:07.110068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 616/1218] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:07.116153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f3b0e-815b-4bd9-8686-8dbabff247d5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:07.237623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f3b0e-815b-4bd9-8686-8dbabff247d5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:07.268675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:07.274475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6fdac-ead1-415a-b2ed-426ab58e57e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:07.275127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6fdac-ead1-415a-b2ed-426ab58e57e2 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:07.275413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6fdac-ead1-415a-b2ed-426ab58e57e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:07.275690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6fdac-ead1-415a-b2ed-426ab58e57e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:07.276602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6fdac-ead1-415a-b2ed-426ab58e57e2 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=a5997b3965f44d6fbdf55cccdfc52ff7) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:07.276942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6fdac-ead1-415a-b2ed-426ab58e57e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:07.278412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6fdac-ead1-415a-b2ed-426ab58e57e2 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:07.284943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 603/1219] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:30:07 2022] GET /identity/v3/role_assignments?user.id=a5997b3965f44d6fbdf55cccdfc52ff7&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:09.439726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b383147-fdf3-46ff-a552-e87be2448d5d None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:09.440232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b383147-fdf3-46ff-a552-e87be2448d5d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:09.440375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b383147-fdf3-46ff-a552-e87be2448d5d None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:09.441671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 617/1220] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:09.447029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939a187-35e6-4204-866c-927ec60ff5d0 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:09.447514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939a187-35e6-4204-866c-927ec60ff5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:09.447722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939a187-35e6-4204-866c-927ec60ff5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:09.465013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-3939a187-35e6-4204-866c-927ec60ff5d0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:09.466355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3939a187-35e6-4204-866c-927ec60ff5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:09.535528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 604/1221] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:09.558872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b383147-fdf3-46ff-a552-e87be2448d5d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:09.665609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b383147-fdf3-46ff-a552-e87be2448d5d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:09.699405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1525aa-8086-49f9-88d5-ce212c0630f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:09.700234 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1525aa-8086-49f9-88d5-ce212c0630f4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:09.700553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1525aa-8086-49f9-88d5-ce212c0630f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:09.700884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1525aa-8086-49f9-88d5-ce212c0630f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:09.712085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1525aa-8086-49f9-88d5-ce212c0630f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-ee1525aa-8086-49f9-88d5-ce212c0630f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:30:09.719999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:09.721139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:09.722256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 618/1222] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:30:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:30:09.727254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939a187-35e6-4204-866c-927ec60ff5d0 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:09.827445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939a187-35e6-4204-866c-927ec60ff5d0 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:09.851231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:09.862281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be16be8-5567-45be-af8e-415d005d1892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:09.862950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be16be8-5567-45be-af8e-415d005d1892 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:09.863236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be16be8-5567-45be-af8e-415d005d1892 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:09.863512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be16be8-5567-45be-af8e-415d005d1892 None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:09.864262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be16be8-5567-45be-af8e-415d005d1892 None admin] RBAC: Adding query filter params (name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:09.864645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be16be8-5567-45be-af8e-415d005d1892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:09.866023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be16be8-5567-45be-af8e-415d005d1892 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:09.874694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 605/1223] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:30:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:09.880533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1525aa-8086-49f9-88d5-ce212c0630f4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:09.923326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:09.977016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1525aa-8086-49f9-88d5-ce212c0630f4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:10.011449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161583-7800-4f0d-b543-7e1aa8cd4cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:10.012269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161583-7800-4f0d-b543-7e1aa8cd4cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:10.012583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161583-7800-4f0d-b543-7e1aa8cd4cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:10.012860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161583-7800-4f0d-b543-7e1aa8cd4cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:10.022942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161583-7800-4f0d-b543-7e1aa8cd4cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:10.024406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161583-7800-4f0d-b543-7e1aa8cd4cd6 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-bb161583-7800-4f0d-b543-7e1aa8cd4cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:10.041402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:10.043743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:10.044905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:10.044905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:10.044905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:10.044905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:10.044905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 619/1224] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:10.049138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be16be8-5567-45be-af8e-415d005d1892 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:10.149769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be16be8-5567-45be-af8e-415d005d1892 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:10.183168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31665-5018-4f5a-9fb4-b4e8d327072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:10.183818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31665-5018-4f5a-9fb4-b4e8d327072d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:10.184100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31665-5018-4f5a-9fb4-b4e8d327072d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:10.184408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31665-5018-4f5a-9fb4-b4e8d327072d None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:10.185124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31665-5018-4f5a-9fb4-b4e8d327072d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:10.185427 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31665-5018-4f5a-9fb4-b4e8d327072d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:10.186829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31665-5018-4f5a-9fb4-b4e8d327072d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:10.198678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 606/1225] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:10.204318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161583-7800-4f0d-b543-7e1aa8cd4cd6 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:10.299269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:10.305773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161583-7800-4f0d-b543-7e1aa8cd4cd6 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:10.341046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014e62f-6e7a-4fb8-a2fe-aa94a8a2f3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:10.341846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014e62f-6e7a-4fb8-a2fe-aa94a8a2f3da None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:10.342703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014e62f-6e7a-4fb8-a2fe-aa94a8a2f3da None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:10.342981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014e62f-6e7a-4fb8-a2fe-aa94a8a2f3da None admin] PATH_INFO: `/v3/users/placement` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:10.349986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014e62f-6e7a-4fb8-a2fe-aa94a8a2f3da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:10.355398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014e62f-6e7a-4fb8-a2fe-aa94a8a2f3da None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-1014e62f-6e7a-4fb8-a2fe-aa94a8a2f3da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:30:10.366558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:10.367673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:10.368921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 620/1226] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:10.373968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31665-5018-4f5a-9fb4-b4e8d327072d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:10.419448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:10.470336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31665-5018-4f5a-9fb4-b4e8d327072d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:10.503433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc657c-f9a6-4f25-a810-455831858552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:10.504107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc657c-f9a6-4f25-a810-455831858552 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:10.504441 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc657c-f9a6-4f25-a810-455831858552 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:10.504726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc657c-f9a6-4f25-a810-455831858552 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:10.505565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc657c-f9a6-4f25-a810-455831858552 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:10.506120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc657c-f9a6-4f25-a810-455831858552 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:10.507562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc657c-f9a6-4f25-a810-455831858552 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:10.524865 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 607/1227] 10.222.0.74 () {56 vars in 1143 bytes} [Mon May 23 16:30:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:10.531308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014e62f-6e7a-4fb8-a2fe-aa94a8a2f3da None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:10.627366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014e62f-6e7a-4fb8-a2fe-aa94a8a2f3da None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:10.661318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d85197-6a2b-4587-ada0-ac5b9b02afca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:10.662134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d85197-6a2b-4587-ada0-ac5b9b02afca None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:10.662426 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d85197-6a2b-4587-ada0-ac5b9b02afca None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:10.662649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d85197-6a2b-4587-ada0-ac5b9b02afca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:10.672414 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d85197-6a2b-4587-ada0-ac5b9b02afca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:10.673848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d85197-6a2b-4587-ada0-ac5b9b02afca None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-04d85197-6a2b-4587-ada0-ac5b9b02afca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:10.691850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:10.692947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:10.694258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:10.694258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:10.694258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:10.694258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:10.694258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 621/1228] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:10.698792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc657c-f9a6-4f25-a810-455831858552 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:10.800653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc657c-f9a6-4f25-a810-455831858552 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:10.802875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:10.834659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b1394-22b7-4aac-9c29-80a8266ce68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:10.835318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1394-22b7-4aac-9c29-80a8266ce68f None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:10.835659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1394-22b7-4aac-9c29-80a8266ce68f None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:10.835933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1394-22b7-4aac-9c29-80a8266ce68f None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:10.836681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b1394-22b7-4aac-9c29-80a8266ce68f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:10.837078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b1394-22b7-4aac-9c29-80a8266ce68f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:10.838455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b1394-22b7-4aac-9c29-80a8266ce68f None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:10.850392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 608/1229] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:10.856139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d85197-6a2b-4587-ada0-ac5b9b02afca None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:10.865897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:10.957004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d85197-6a2b-4587-ada0-ac5b9b02afca None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:10.990053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3238d4a-4210-4215-8ae1-b4e9129a160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:10.990836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3238d4a-4210-4215-8ae1-b4e9129a160a None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:10.991115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3238d4a-4210-4215-8ae1-b4e9129a160a None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:10.991404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3238d4a-4210-4215-8ae1-b4e9129a160a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:10.997953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3238d4a-4210-4215-8ae1-b4e9129a160a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:11.000072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3238d4a-4210-4215-8ae1-b4e9129a160a None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-d3238d4a-4210-4215-8ae1-b4e9129a160a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:30:11.015354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:11.016465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:11.017757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:30:11.017757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:30:11.017757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:30:11.017757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:30:11.017757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:30:11.017757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:30:11.017757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:11.017757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:11.017757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 622/1230] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:11.022317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b1394-22b7-4aac-9c29-80a8266ce68f None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:11.120431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b1394-22b7-4aac-9c29-80a8266ce68f None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:11.155507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0113e-06e6-4e4d-a670-0ef5d0dde645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:11.156156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0113e-06e6-4e4d-a670-0ef5d0dde645 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:11.156473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0113e-06e6-4e4d-a670-0ef5d0dde645 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:11.156759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0113e-06e6-4e4d-a670-0ef5d0dde645 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:11.157518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0113e-06e6-4e4d-a670-0ef5d0dde645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:11.157819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0113e-06e6-4e4d-a670-0ef5d0dde645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:11.159240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0113e-06e6-4e4d-a670-0ef5d0dde645 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:11.170974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 609/1231] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:30:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:11.178914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3238d4a-4210-4215-8ae1-b4e9129a160a None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:11.252643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:11.287889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3238d4a-4210-4215-8ae1-b4e9129a160a None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:11.322783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe18b57-5f77-4eb5-b28c-d76ba299d76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:11.323662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe18b57-5f77-4eb5-b28c-d76ba299d76d None admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:11.323948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe18b57-5f77-4eb5-b28c-d76ba299d76d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:11.324224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe18b57-5f77-4eb5-b28c-d76ba299d76d None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/a5997b3965f44d6fbdf55cccdfc52ff7/roles/e521dfb490db4640aa9c1390bf4e209e` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:11.339059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe18b57-5f77-4eb5-b28c-d76ba299d76d None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=a5997b3965f44d6fbdf55cccdfc52ff7, role_id=e521dfb490db4640aa9c1390bf4e209e)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:11.340539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe18b57-5f77-4eb5-b28c-d76ba299d76d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:11.408317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 623/1232] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:30:11 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/a5997b3965f44d6fbdf55cccdfc52ff7/roles/e521dfb490db4640aa9c1390bf4e209e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:30:13.647306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff214b-ddd6-4a1d-b690-ecf334d31886 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:13.647879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff214b-ddd6-4a1d-b690-ecf334d31886 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:13.647879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff214b-ddd6-4a1d-b690-ecf334d31886 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:13.649275 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 610/1233] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:13.655285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8f62c-2ca6-4159-aebb-02c0c659c68b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:13.655790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8f62c-2ca6-4159-aebb-02c0c659c68b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:13.655894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8f62c-2ca6-4159-aebb-02c0c659c68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:13.672093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-e4d8f62c-2ca6-4159-aebb-02c0c659c68b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:13.673301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e4d8f62c-2ca6-4159-aebb-02c0c659c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:13.737265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 624/1234] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:13.761241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff214b-ddd6-4a1d-b690-ecf334d31886 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:13.786922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:13.861188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff214b-ddd6-4a1d-b690-ecf334d31886 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:13.895100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66095f-473b-429e-9fb9-1f1399d5fd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:13.895880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66095f-473b-429e-9fb9-1f1399d5fd2a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:13.896158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66095f-473b-429e-9fb9-1f1399d5fd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:13.896456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66095f-473b-429e-9fb9-1f1399d5fd2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:13.906774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66095f-473b-429e-9fb9-1f1399d5fd2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-3d66095f-473b-429e-9fb9-1f1399d5fd2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:30:13.914347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:13.915354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:13.916517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 611/1235] 10.222.0.74 () {56 vars in 1102 bytes} [Mon May 23 16:30:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:13.921556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8f62c-2ca6-4159-aebb-02c0c659c68b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:13.966372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:14.017246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8f62c-2ca6-4159-aebb-02c0c659c68b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:14.049097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d5258-0ea9-4ec3-8063-e73c154f3ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:14.049757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d5258-0ea9-4ec3-8063-e73c154f3ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:14.050039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d5258-0ea9-4ec3-8063-e73c154f3ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:14.050314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d5258-0ea9-4ec3-8063-e73c154f3ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:14.051102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d5258-0ea9-4ec3-8063-e73c154f3ce8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:14.051447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d5258-0ea9-4ec3-8063-e73c154f3ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:14.052843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d5258-0ea9-4ec3-8063-e73c154f3ce8 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:14.060968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 625/1236] 10.222.0.74 () {56 vars in 1103 bytes} [Mon May 23 16:30:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:14.067024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66095f-473b-429e-9fb9-1f1399d5fd2a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:14.152352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:14.167555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66095f-473b-429e-9fb9-1f1399d5fd2a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:14.200533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da568fac-efd5-4b0f-941c-11da50c18405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:14.201904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da568fac-efd5-4b0f-941c-11da50c18405 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:14.202185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da568fac-efd5-4b0f-941c-11da50c18405 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:14.202458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da568fac-efd5-4b0f-941c-11da50c18405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:14.212246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da568fac-efd5-4b0f-941c-11da50c18405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:14.213736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da568fac-efd5-4b0f-941c-11da50c18405 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-da568fac-efd5-4b0f-941c-11da50c18405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:14.231475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:14.232814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:14.233857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:14.233857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:14.233857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:14.233857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:14.233857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 612/1237] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:30:14.238978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d5258-0ea9-4ec3-8063-e73c154f3ce8 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:14.339929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d5258-0ea9-4ec3-8063-e73c154f3ce8 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:14.348851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:14.374207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797048ee-6976-4b93-9211-d593af77c3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:14.374872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797048ee-6976-4b93-9211-d593af77c3ac None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:14.375154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797048ee-6976-4b93-9211-d593af77c3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:14.375425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797048ee-6976-4b93-9211-d593af77c3ac None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:14.376145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797048ee-6976-4b93-9211-d593af77c3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:14.376600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797048ee-6976-4b93-9211-d593af77c3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:14.377974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797048ee-6976-4b93-9211-d593af77c3ac None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:14.391743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 626/1238] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:30:14.397264 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da568fac-efd5-4b0f-941c-11da50c18405 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:14.496343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da568fac-efd5-4b0f-941c-11da50c18405 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:14.530805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06adb9-a28b-411d-a706-dc563a432e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:14.531598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06adb9-a28b-411d-a706-dc563a432e8d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:14.531881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06adb9-a28b-411d-a706-dc563a432e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:14.532155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06adb9-a28b-411d-a706-dc563a432e8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:14.534794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:14.539361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06adb9-a28b-411d-a706-dc563a432e8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:14.540872 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06adb9-a28b-411d-a706-dc563a432e8d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-dc06adb9-a28b-411d-a706-dc563a432e8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:30:14.555949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:14.561639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:14.562728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 613/1239] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:14.563437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797048ee-6976-4b93-9211-d593af77c3ac None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:14.664631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797048ee-6976-4b93-9211-d593af77c3ac None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:14.699631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b253b90-e004-4f16-94f8-558066554ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:14.700388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b253b90-e004-4f16-94f8-558066554ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:14.700610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b253b90-e004-4f16-94f8-558066554ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:14.700883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b253b90-e004-4f16-94f8-558066554ce2 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:14.702413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b253b90-e004-4f16-94f8-558066554ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:14.702719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b253b90-e004-4f16-94f8-558066554ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:14.704240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b253b90-e004-4f16-94f8-558066554ce2 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:14.722216 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 627/1240] 10.222.0.74 () {56 vars in 1143 bytes} [Mon May 23 16:30:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:14.728363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06adb9-a28b-411d-a706-dc563a432e8d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:14.846535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06adb9-a28b-411d-a706-dc563a432e8d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:14.881194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2cb70-aca9-462f-9ffb-58005fb1946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:14.881856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2cb70-aca9-462f-9ffb-58005fb1946a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:14.882135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2cb70-aca9-462f-9ffb-58005fb1946a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:14.882403 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2cb70-aca9-462f-9ffb-58005fb1946a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:14.944347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:14.950813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2cb70-aca9-462f-9ffb-58005fb1946a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:14.953348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2cb70-aca9-462f-9ffb-58005fb1946a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:15.065554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 614/1241] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:30:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:30:15.071491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b253b90-e004-4f16-94f8-558066554ce2 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:15.101462 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:15.177368 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b253b90-e004-4f16-94f8-558066554ce2 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:15.214361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc120f-1df6-4de7-b07b-268f1b5dfd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:15.215170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc120f-1df6-4de7-b07b-268f1b5dfd2e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:15.215508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc120f-1df6-4de7-b07b-268f1b5dfd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:15.216338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc120f-1df6-4de7-b07b-268f1b5dfd2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:15.226719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc120f-1df6-4de7-b07b-268f1b5dfd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:15.228173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc120f-1df6-4de7-b07b-268f1b5dfd2e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-e6dc120f-1df6-4de7-b07b-268f1b5dfd2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:15.246750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:15.247751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:15.254056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:15.254056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:15.254056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:15.254056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:15.254056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 628/1242] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:15.254504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2cb70-aca9-462f-9ffb-58005fb1946a None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:15.352930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:15.359016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2cb70-aca9-462f-9ffb-58005fb1946a None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:15.392918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d22b-4814-43c5-aa61-c1391af95eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:15.393522 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d22b-4814-43c5-aa61-c1391af95eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:15.393810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d22b-4814-43c5-aa61-c1391af95eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:15.394090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d22b-4814-43c5-aa61-c1391af95eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:15.394809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d22b-4814-43c5-aa61-c1391af95eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:15.395118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d22b-4814-43c5-aa61-c1391af95eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:15.396559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d22b-4814-43c5-aa61-c1391af95eb5 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:15.408480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 615/1243] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:15.414690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc120f-1df6-4de7-b07b-268f1b5dfd2e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:15.492359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:15.513858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc120f-1df6-4de7-b07b-268f1b5dfd2e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:15.547977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cc687-9dbf-4011-9c44-179cfc7a9050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:15.548792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cc687-9dbf-4011-9c44-179cfc7a9050 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:15.549074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cc687-9dbf-4011-9c44-179cfc7a9050 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:15.549348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cc687-9dbf-4011-9c44-179cfc7a9050 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:15.556028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cc687-9dbf-4011-9c44-179cfc7a9050 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:15.557517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cc687-9dbf-4011-9c44-179cfc7a9050 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-ef2cc687-9dbf-4011-9c44-179cfc7a9050 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:30:15.570951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:15.571892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:15.575671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:30:15.575671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:30:15.575671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:30:15.575671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:30:15.575671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:30:15.575671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:30:15.575671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:15.575671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:15.575671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 629/1244] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:15.578508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d22b-4814-43c5-aa61-c1391af95eb5 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:15.680485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d22b-4814-43c5-aa61-c1391af95eb5 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:15.714883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf279f1-05f3-468f-80fe-bd20f8524637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:15.715556 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf279f1-05f3-468f-80fe-bd20f8524637 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:15.715835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf279f1-05f3-468f-80fe-bd20f8524637 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:15.716104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf279f1-05f3-468f-80fe-bd20f8524637 None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:15.717018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf279f1-05f3-468f-80fe-bd20f8524637 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:15.717337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf279f1-05f3-468f-80fe-bd20f8524637 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:15.718756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf279f1-05f3-468f-80fe-bd20f8524637 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:15.731136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 616/1245] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:15.737742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cc687-9dbf-4011-9c44-179cfc7a9050 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:15.841567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cc687-9dbf-4011-9c44-179cfc7a9050 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:15.876239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e061136-ae59-435e-abec-ef3e07d186b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:15.876942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e061136-ae59-435e-abec-ef3e07d186b0 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:15.877226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e061136-ae59-435e-abec-ef3e07d186b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:15.877500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e061136-ae59-435e-abec-ef3e07d186b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:15.878324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e061136-ae59-435e-abec-ef3e07d186b0 None admin] RBAC: Adding query filter params (role.id=e521dfb490db4640aa9c1390bf4e209e, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=a5997b3965f44d6fbdf55cccdfc52ff7) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:15.878637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e061136-ae59-435e-abec-ef3e07d186b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:15.880065 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e061136-ae59-435e-abec-ef3e07d186b0 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:15.886081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 630/1246] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:30:15 2022] GET /identity/v3/role_assignments?user.id=a5997b3965f44d6fbdf55cccdfc52ff7&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=e521dfb490db4640aa9c1390bf4e209e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:18.121636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f3563-9193-4d58-877c-771497e7e7de None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:18.122186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f3563-9193-4d58-877c-771497e7e7de None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:18.122298 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f3563-9193-4d58-877c-771497e7e7de None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:18.124190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 617/1247] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:18.129573 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c148d27-6aaf-4b8a-94df-eb6790f47437 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:18.130001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c148d27-6aaf-4b8a-94df-eb6790f47437 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:18.130131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c148d27-6aaf-4b8a-94df-eb6790f47437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:18.135450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:18.148085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-3c148d27-6aaf-4b8a-94df-eb6790f47437 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:18.149302 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3c148d27-6aaf-4b8a-94df-eb6790f47437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:18.220960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 631/1248] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:18.245132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f3563-9193-4d58-877c-771497e7e7de None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:18.264699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:18.347737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f3563-9193-4d58-877c-771497e7e7de None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:18.382785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51bafc-7e02-46e4-917f-bfc55a91f10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:18.383504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51bafc-7e02-46e4-917f-bfc55a91f10b None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:18.383787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51bafc-7e02-46e4-917f-bfc55a91f10b None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:18.384062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51bafc-7e02-46e4-917f-bfc55a91f10b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:18.396116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51bafc-7e02-46e4-917f-bfc55a91f10b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-4a51bafc-7e02-46e4-917f-bfc55a91f10b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:30:18.404574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:18.405695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:18.406853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 618/1249] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:30:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:18.412113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c148d27-6aaf-4b8a-94df-eb6790f47437 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:18.509950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c148d27-6aaf-4b8a-94df-eb6790f47437 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:18.539210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:18.543885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcff6c-d998-4f08-aded-28bb3835a0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:18.544616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcff6c-d998-4f08-aded-28bb3835a0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:18.544919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcff6c-d998-4f08-aded-28bb3835a0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:18.545260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcff6c-d998-4f08-aded-28bb3835a0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:18.545936 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcff6c-d998-4f08-aded-28bb3835a0e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:18.546239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcff6c-d998-4f08-aded-28bb3835a0e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:18.547603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcff6c-d998-4f08-aded-28bb3835a0e4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:18.555466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 632/1250] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:30:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:18.565908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51bafc-7e02-46e4-917f-bfc55a91f10b None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:18.644012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:18.666835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51bafc-7e02-46e4-917f-bfc55a91f10b None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:18.703707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246182ff-323b-4d30-b762-3038a7d56e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:18.704528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246182ff-323b-4d30-b762-3038a7d56e49 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:18.704805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246182ff-323b-4d30-b762-3038a7d56e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:18.705074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246182ff-323b-4d30-b762-3038a7d56e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:18.715484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246182ff-323b-4d30-b762-3038a7d56e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:18.716989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246182ff-323b-4d30-b762-3038a7d56e49 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-246182ff-323b-4d30-b762-3038a7d56e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:18.733486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:18.734473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:18.735379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:18.735379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:18.735379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:18.735379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:18.735379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 619/1251] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:18.740557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcff6c-d998-4f08-aded-28bb3835a0e4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:18.843791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcff6c-d998-4f08-aded-28bb3835a0e4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:18.876903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00963896-35bb-43c5-8fd1-69f92564b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:18.877556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00963896-35bb-43c5-8fd1-69f92564b45b None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:18.877838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00963896-35bb-43c5-8fd1-69f92564b45b None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:18.878109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00963896-35bb-43c5-8fd1-69f92564b45b None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:18.878819 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00963896-35bb-43c5-8fd1-69f92564b45b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:18.879124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00963896-35bb-43c5-8fd1-69f92564b45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:18.880791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00963896-35bb-43c5-8fd1-69f92564b45b None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:18.893082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 633/1252] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:18.898918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246182ff-323b-4d30-b762-3038a7d56e49 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:18.996381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246182ff-323b-4d30-b762-3038a7d56e49 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:19.022114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:19.029711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737ab63-2266-449a-a3b6-e463ec17f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:19.030500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737ab63-2266-449a-a3b6-e463ec17f567 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:19.030784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737ab63-2266-449a-a3b6-e463ec17f567 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:19.031056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737ab63-2266-449a-a3b6-e463ec17f567 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:19.038277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737ab63-2266-449a-a3b6-e463ec17f567 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:19.039800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737ab63-2266-449a-a3b6-e463ec17f567 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-3737ab63-2266-449a-a3b6-e463ec17f567 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:30:19.054351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:19.055527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:19.056545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 620/1253] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 16:30:19.061990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00963896-35bb-43c5-8fd1-69f92564b45b None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:19.116375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:19.163964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00963896-35bb-43c5-8fd1-69f92564b45b None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:19.196711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477b814-890e-4559-85d5-aebe22de4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:19.197439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477b814-890e-4559-85d5-aebe22de4fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:19.197719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477b814-890e-4559-85d5-aebe22de4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:19.197990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477b814-890e-4559-85d5-aebe22de4fd9 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:19.198847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477b814-890e-4559-85d5-aebe22de4fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:19.199152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477b814-890e-4559-85d5-aebe22de4fd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:19.200740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477b814-890e-4559-85d5-aebe22de4fd9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:19.218518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 634/1254] 10.222.0.74 () {56 vars in 1143 bytes} [Mon May 23 16:30:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:19.224259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737ab63-2266-449a-a3b6-e463ec17f567 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:19.325117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737ab63-2266-449a-a3b6-e463ec17f567 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:19.359199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7d72c-0937-4972-93e0-439d3582ad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:19.359842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7d72c-0937-4972-93e0-439d3582ad31 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:19.360129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7d72c-0937-4972-93e0-439d3582ad31 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:19.360440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7d72c-0937-4972-93e0-439d3582ad31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:19.414828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:19.427464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7d72c-0937-4972-93e0-439d3582ad31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:19.428955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7d72c-0937-4972-93e0-439d3582ad31 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:19.528467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 621/1255] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:30:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:30:19.534898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477b814-890e-4559-85d5-aebe22de4fd9 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:19.635963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477b814-890e-4559-85d5-aebe22de4fd9 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:19.649066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:19.669206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2d614-ee6c-4514-9aea-27e530e35b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:19.670596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2d614-ee6c-4514-9aea-27e530e35b0e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:19.670879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2d614-ee6c-4514-9aea-27e530e35b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:19.671152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2d614-ee6c-4514-9aea-27e530e35b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:19.681023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2d614-ee6c-4514-9aea-27e530e35b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:19.682475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2d614-ee6c-4514-9aea-27e530e35b0e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-7fd2d614-ee6c-4514-9aea-27e530e35b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:19.700804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:19.702253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:19.703220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:19.703220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:19.703220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:19.703220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:19.703220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 635/1256] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:19.707997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7d72c-0937-4972-93e0-439d3582ad31 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:19.802955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:19.815592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7d72c-0937-4972-93e0-439d3582ad31 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:19.852813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda866b-c7f8-4a4a-aabb-370167cc4c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:19.853476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda866b-c7f8-4a4a-aabb-370167cc4c2c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:19.853841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda866b-c7f8-4a4a-aabb-370167cc4c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:19.854121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda866b-c7f8-4a4a-aabb-370167cc4c2c None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:19.854842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda866b-c7f8-4a4a-aabb-370167cc4c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:19.855149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda866b-c7f8-4a4a-aabb-370167cc4c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:19.856722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda866b-c7f8-4a4a-aabb-370167cc4c2c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:19.869357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 622/1257] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:19.875531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2d614-ee6c-4514-9aea-27e530e35b0e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:19.981379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2d614-ee6c-4514-9aea-27e530e35b0e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:20.017408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1805e-143b-42d7-b7db-2c18d07538f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:20.018231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1805e-143b-42d7-b7db-2c18d07538f9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:20.018519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1805e-143b-42d7-b7db-2c18d07538f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:20.018795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1805e-143b-42d7-b7db-2c18d07538f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:20.025748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1805e-143b-42d7-b7db-2c18d07538f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:20.027196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1805e-143b-42d7-b7db-2c18d07538f9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-02a1805e-143b-42d7-b7db-2c18d07538f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:30:20.041815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:20.042914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:20.044382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:30:20.044382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:30:20.044382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:30:20.044382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:30:20.044382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:30:20.044382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:30:20.044382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:20.044382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:20.044382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 636/1258] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:20.049569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda866b-c7f8-4a4a-aabb-370167cc4c2c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:20.157698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda866b-c7f8-4a4a-aabb-370167cc4c2c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:20.192323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9974-5bac-4191-9fa4-2a6a69b3e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:20.192994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9974-5bac-4191-9fa4-2a6a69b3e5ab None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:20.195414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9974-5bac-4191-9fa4-2a6a69b3e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:20.195414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9974-5bac-4191-9fa4-2a6a69b3e5ab None admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:20.195414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9974-5bac-4191-9fa4-2a6a69b3e5ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:20.195414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9974-5bac-4191-9fa4-2a6a69b3e5ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:20.196078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9974-5bac-4191-9fa4-2a6a69b3e5ab None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:20.209018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 623/1259] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:30:20.215458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1805e-143b-42d7-b7db-2c18d07538f9 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:20.246366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:20.322373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1805e-143b-42d7-b7db-2c18d07538f9 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:20.358062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37a29e-35cd-4e21-bd9e-84b5ac0ef69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:20.358715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37a29e-35cd-4e21-bd9e-84b5ac0ef69c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:20.358996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37a29e-35cd-4e21-bd9e-84b5ac0ef69c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:20.359270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37a29e-35cd-4e21-bd9e-84b5ac0ef69c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:20.360093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37a29e-35cd-4e21-bd9e-84b5ac0ef69c None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=a5997b3965f44d6fbdf55cccdfc52ff7) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:20.360461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37a29e-35cd-4e21-bd9e-84b5ac0ef69c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:20.361890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37a29e-35cd-4e21-bd9e-84b5ac0ef69c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:20.367422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 637/1260] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:30:20 2022] GET /identity/v3/role_assignments?user.id=a5997b3965f44d6fbdf55cccdfc52ff7&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:22.530870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5168a-0cd9-4fd2-92c0-fc1dc1d586ef None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:22.531397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5168a-0cd9-4fd2-92c0-fc1dc1d586ef None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:22.531493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5168a-0cd9-4fd2-92c0-fc1dc1d586ef None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:22.532889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 624/1261] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:22.542161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a30e4-4760-43d7-b205-0bfee7a17450 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:22.542657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a30e4-4760-43d7-b205-0bfee7a17450 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:22.542757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a30e4-4760-43d7-b205-0bfee7a17450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:22.559903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0b5a30e4-4760-43d7-b205-0bfee7a17450 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:22.561206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0b5a30e4-4760-43d7-b205-0bfee7a17450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:22.627419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 638/1262] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:22.650310 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5168a-0cd9-4fd2-92c0-fc1dc1d586ef None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:22.662077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:22.750855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5168a-0cd9-4fd2-92c0-fc1dc1d586ef None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:22.785309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdfa92-70df-416c-84ad-d7b857cadb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:22.786027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdfa92-70df-416c-84ad-d7b857cadb77 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:22.786307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdfa92-70df-416c-84ad-d7b857cadb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:22.786574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdfa92-70df-416c-84ad-d7b857cadb77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:22.796473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdfa92-70df-416c-84ad-d7b857cadb77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-85cdfa92-70df-416c-84ad-d7b857cadb77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:30:22.803997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:22.805198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:22.806267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 625/1263] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:30:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:22.813459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a30e4-4760-43d7-b205-0bfee7a17450 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:22.830750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:22.913351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a30e4-4760-43d7-b205-0bfee7a17450 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:22.948122 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148742c3-74a4-4896-b29b-b5ee040d7266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:22.948813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148742c3-74a4-4896-b29b-b5ee040d7266 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:22.949094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148742c3-74a4-4896-b29b-b5ee040d7266 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:22.949416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148742c3-74a4-4896-b29b-b5ee040d7266 None admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:22.950148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148742c3-74a4-4896-b29b-b5ee040d7266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:22.950528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148742c3-74a4-4896-b29b-b5ee040d7266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:22.952558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148742c3-74a4-4896-b29b-b5ee040d7266 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:22.961126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 639/1264] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:30:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:22.967423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdfa92-70df-416c-84ad-d7b857cadb77 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:23.044575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:23.072591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdfa92-70df-416c-84ad-d7b857cadb77 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:23.105623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5122e48-8695-4d2a-9954-bc6638899f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:23.106414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5122e48-8695-4d2a-9954-bc6638899f6c None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:23.106703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5122e48-8695-4d2a-9954-bc6638899f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:23.106972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5122e48-8695-4d2a-9954-bc6638899f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:23.117077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5122e48-8695-4d2a-9954-bc6638899f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:23.118520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5122e48-8695-4d2a-9954-bc6638899f6c None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-e5122e48-8695-4d2a-9954-bc6638899f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:23.136125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:23.140843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:23.142025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:23.142025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:23.142025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:23.142025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:23.142025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 626/1265] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:23.143827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148742c3-74a4-4896-b29b-b5ee040d7266 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:23.229437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:23.248142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148742c3-74a4-4896-b29b-b5ee040d7266 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:23.281099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883f50d-df26-4d0f-82a9-3944197157e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:23.281759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f50d-df26-4d0f-82a9-3944197157e4 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:23.282041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f50d-df26-4d0f-82a9-3944197157e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:23.282314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f50d-df26-4d0f-82a9-3944197157e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:23.283030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883f50d-df26-4d0f-82a9-3944197157e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:23.283336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883f50d-df26-4d0f-82a9-3944197157e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:23.284737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883f50d-df26-4d0f-82a9-3944197157e4 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:23.298583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 640/1266] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:23.301797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5122e48-8695-4d2a-9954-bc6638899f6c None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:23.406194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5122e48-8695-4d2a-9954-bc6638899f6c None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:23.426414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:23.440787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf58c-c47f-4d84-987e-aaa179d74658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:23.441584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf58c-c47f-4d84-987e-aaa179d74658 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:23.441870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf58c-c47f-4d84-987e-aaa179d74658 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:23.442156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf58c-c47f-4d84-987e-aaa179d74658 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:23.450968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bf58c-c47f-4d84-987e-aaa179d74658 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:23.452716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bf58c-c47f-4d84-987e-aaa179d74658 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-6e2bf58c-c47f-4d84-987e-aaa179d74658 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:30:23.467454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:23.468686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:23.469816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 627/1267] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:23.474671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883f50d-df26-4d0f-82a9-3944197157e4 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:23.577269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883f50d-df26-4d0f-82a9-3944197157e4 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:23.612154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dfac7-ec2c-4243-a1e0-cf94ee926f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:23.612860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dfac7-ec2c-4243-a1e0-cf94ee926f80 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:23.613144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dfac7-ec2c-4243-a1e0-cf94ee926f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:23.613418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dfac7-ec2c-4243-a1e0-cf94ee926f80 None admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:23.614245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dfac7-ec2c-4243-a1e0-cf94ee926f80 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:23.614555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dfac7-ec2c-4243-a1e0-cf94ee926f80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:23.616033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dfac7-ec2c-4243-a1e0-cf94ee926f80 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:23.626088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:23.634177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 641/1268] 10.222.0.74 () {56 vars in 1143 bytes} [Mon May 23 16:30:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:23.640037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf58c-c47f-4d84-987e-aaa179d74658 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:23.739959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf58c-c47f-4d84-987e-aaa179d74658 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:23.774538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca35fc-cc17-4e26-b5b0-bf339aafbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:23.775340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca35fc-cc17-4e26-b5b0-bf339aafbefa None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:23.775624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca35fc-cc17-4e26-b5b0-bf339aafbefa None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:23.775956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca35fc-cc17-4e26-b5b0-bf339aafbefa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:23.787212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca35fc-cc17-4e26-b5b0-bf339aafbefa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:23.788710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca35fc-cc17-4e26-b5b0-bf339aafbefa None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-8bca35fc-cc17-4e26-b5b0-bf339aafbefa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:23.805957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:23.808329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:23.809532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:23.809532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:23.809532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:23.809532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:23.809532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 628/1269] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:23.813387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dfac7-ec2c-4243-a1e0-cf94ee926f80 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:23.927680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dfac7-ec2c-4243-a1e0-cf94ee926f80 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:23.962743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5df12-3727-4ff1-b5ec-73bd546a9eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:23.963404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5df12-3727-4ff1-b5ec-73bd546a9eed None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:23.963688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5df12-3727-4ff1-b5ec-73bd546a9eed None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:23.963964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5df12-3727-4ff1-b5ec-73bd546a9eed None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:23.964713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5df12-3727-4ff1-b5ec-73bd546a9eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:23.965023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5df12-3727-4ff1-b5ec-73bd546a9eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:23.967326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5df12-3727-4ff1-b5ec-73bd546a9eed None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:23.978653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 642/1270] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:30:23.985410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca35fc-cc17-4e26-b5b0-bf339aafbefa None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:24.018686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:24.087705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca35fc-cc17-4e26-b5b0-bf339aafbefa None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:24.123334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba09ee-a8e2-4584-aca3-683a98ad0507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:24.124132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba09ee-a8e2-4584-aca3-683a98ad0507 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:24.124458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba09ee-a8e2-4584-aca3-683a98ad0507 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:24.124741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba09ee-a8e2-4584-aca3-683a98ad0507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:24.131602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba09ee-a8e2-4584-aca3-683a98ad0507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:24.133123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba09ee-a8e2-4584-aca3-683a98ad0507 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-e2ba09ee-a8e2-4584-aca3-683a98ad0507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:30:24.147902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:24.150321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:24.151436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:30:24.151436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:30:24.151436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:30:24.151436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:30:24.151436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:30:24.151436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:30:24.151436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:24.151436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:24.151436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 629/1271] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:30:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:24.155738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5df12-3727-4ff1-b5ec-73bd546a9eed None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:24.214119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:24.257167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5df12-3727-4ff1-b5ec-73bd546a9eed None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:24.291096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1364aff-4685-46cb-882a-f03b5dd386f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:24.291759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1364aff-4685-46cb-882a-f03b5dd386f9 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:24.292093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1364aff-4685-46cb-882a-f03b5dd386f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:24.292398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1364aff-4685-46cb-882a-f03b5dd386f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:24.293183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1364aff-4685-46cb-882a-f03b5dd386f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:24.293496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1364aff-4685-46cb-882a-f03b5dd386f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:24.295031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1364aff-4685-46cb-882a-f03b5dd386f9 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:24.306858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 643/1272] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:30:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:24.313219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba09ee-a8e2-4584-aca3-683a98ad0507 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:24.405319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:24.414307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba09ee-a8e2-4584-aca3-683a98ad0507 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:24.448759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4de19-f37c-410a-afc0-dd9c46ba24cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:24.449660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4de19-f37c-410a-afc0-dd9c46ba24cd None admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:24.450030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4de19-f37c-410a-afc0-dd9c46ba24cd None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:24.450305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4de19-f37c-410a-afc0-dd9c46ba24cd None admin] PATH_INFO: `/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/a5997b3965f44d6fbdf55cccdfc52ff7/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:24.453254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4de19-f37c-410a-afc0-dd9c46ba24cd None admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd51ba67a49918509c136e8f7d21a, user_id=a5997b3965f44d6fbdf55cccdfc52ff7, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:24.454706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4de19-f37c-410a-afc0-dd9c46ba24cd None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:24.522478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 630/1273] 10.222.0.74 () {58 vars in 1439 bytes} [Mon May 23 16:30:24 2022] PUT /identity/v3/projects/86fcd51ba67a49918509c136e8f7d21a/users/a5997b3965f44d6fbdf55cccdfc52ff7/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:30:26.758489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7333-e762-40a7-94b8-1121852c5c1d None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:26.759031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7333-e762-40a7-94b8-1121852c5c1d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:26.759031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7333-e762-40a7-94b8-1121852c5c1d None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:26.760513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 644/1274] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:26.767135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d822c4-7b24-48a0-89c8-8e6467796d55 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:26.767578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d822c4-7b24-48a0-89c8-8e6467796d55 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:26.767700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d822c4-7b24-48a0-89c8-8e6467796d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:26.784674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d3d822c4-7b24-48a0-89c8-8e6467796d55 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:26.788290 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d3d822c4-7b24-48a0-89c8-8e6467796d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:26.852132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 631/1275] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:26.876323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c7333-e762-40a7-94b8-1121852c5c1d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:26.993535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c7333-e762-40a7-94b8-1121852c5c1d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:27.011289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:27.028125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff14d-7b83-4e7f-82a7-b8de59a4f773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:27.029882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff14d-7b83-4e7f-82a7-b8de59a4f773 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:27.030165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff14d-7b83-4e7f-82a7-b8de59a4f773 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:27.030443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff14d-7b83-4e7f-82a7-b8de59a4f773 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:27.040269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff14d-7b83-4e7f-82a7-b8de59a4f773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-6b1ff14d-7b83-4e7f-82a7-b8de59a4f773 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 16:30:27.049305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:27.050460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:27.051440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 645/1276] 10.222.0.74 () {56 vars in 1096 bytes} [Mon May 23 16:30:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:27.056738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d822c4-7b24-48a0-89c8-8e6467796d55 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:27.138693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:27.157009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d822c4-7b24-48a0-89c8-8e6467796d55 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:27.190646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df769b7e-568e-4120-a735-d745272b2a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:27.191324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df769b7e-568e-4120-a735-d745272b2a6d None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:27.191638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df769b7e-568e-4120-a735-d745272b2a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:27.191918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df769b7e-568e-4120-a735-d745272b2a6d None admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:27.192711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df769b7e-568e-4120-a735-d745272b2a6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:27.193047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df769b7e-568e-4120-a735-d745272b2a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:27.194440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df769b7e-568e-4120-a735-d745272b2a6d None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:27.203774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 632/1277] 10.222.0.74 () {56 vars in 1099 bytes} [Mon May 23 16:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:27.209470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff14d-7b83-4e7f-82a7-b8de59a4f773 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:27.312318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff14d-7b83-4e7f-82a7-b8de59a4f773 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:27.347186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8b957-f4e1-4b42-83ba-fe3696f7db01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:27.347975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8b957-f4e1-4b42-83ba-fe3696f7db01 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:27.348260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8b957-f4e1-4b42-83ba-fe3696f7db01 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:27.348594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8b957-f4e1-4b42-83ba-fe3696f7db01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:27.360194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8b957-f4e1-4b42-83ba-fe3696f7db01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:27.364686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8b957-f4e1-4b42-83ba-fe3696f7db01 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-7ca8b957-f4e1-4b42-83ba-fe3696f7db01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:27.379021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:27.380398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:27.381508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:27.381508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:27.381508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:27.381508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:27.381508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 646/1278] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:27.386262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df769b7e-568e-4120-a735-d745272b2a6d None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:27.487657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df769b7e-568e-4120-a735-d745272b2a6d None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:27.522278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed9cc0-0db7-4aba-93b3-1b2b330dcd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:27.522936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9cc0-0db7-4aba-93b3-1b2b330dcd28 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:27.523218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9cc0-0db7-4aba-93b3-1b2b330dcd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:27.523489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed9cc0-0db7-4aba-93b3-1b2b330dcd28 None admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:27.524270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed9cc0-0db7-4aba-93b3-1b2b330dcd28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:27.524644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed9cc0-0db7-4aba-93b3-1b2b330dcd28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:27.525988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed9cc0-0db7-4aba-93b3-1b2b330dcd28 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:27.538205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 633/1279] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:27.544616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8b957-f4e1-4b42-83ba-fe3696f7db01 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:27.578095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:27.659836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8b957-f4e1-4b42-83ba-fe3696f7db01 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:27.696132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6909-c7df-49b0-9f58-7fb002c0cedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:27.696984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6909-c7df-49b0-9f58-7fb002c0cedf None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:27.697263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6909-c7df-49b0-9f58-7fb002c0cedf None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:27.697537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6909-c7df-49b0-9f58-7fb002c0cedf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:27.706511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f6909-c7df-49b0-9f58-7fb002c0cedf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:27.708210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f6909-c7df-49b0-9f58-7fb002c0cedf None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-946f6909-c7df-49b0-9f58-7fb002c0cedf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 16:30:27.725159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:27.735476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:27.736714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 647/1280] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:27.737503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed9cc0-0db7-4aba-93b3-1b2b330dcd28 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:27.738217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:27.846340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed9cc0-0db7-4aba-93b3-1b2b330dcd28 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:27.885254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d39d3-d89c-4870-962b-f570a13d8d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:27.891523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d39d3-d89c-4870-962b-f570a13d8d34 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:27.891523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d39d3-d89c-4870-962b-f570a13d8d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:27.891523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d39d3-d89c-4870-962b-f570a13d8d34 None admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:27.891523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d39d3-d89c-4870-962b-f570a13d8d34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:27.891523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d39d3-d89c-4870-962b-f570a13d8d34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:27.891523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d39d3-d89c-4870-962b-f570a13d8d34 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:27.914823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 634/1281] 10.222.0.74 () {56 vars in 1143 bytes} [Mon May 23 16:30:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:27.916264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6909-c7df-49b0-9f58-7fb002c0cedf None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:28.010041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:28.020776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6909-c7df-49b0-9f58-7fb002c0cedf None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:28.058326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78a54e-c782-4939-8745-77e46e5e6b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:28.059097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78a54e-c782-4939-8745-77e46e5e6b3e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:28.059452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78a54e-c782-4939-8745-77e46e5e6b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:28.059839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78a54e-c782-4939-8745-77e46e5e6b3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:28.132025 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78a54e-c782-4939-8745-77e46e5e6b3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:28.133434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78a54e-c782-4939-8745-77e46e5e6b3e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:28.224475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:28.234918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 648/1282] 10.222.0.74 () {58 vars in 1282 bytes} [Mon May 23 16:30:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 16:30:28.242322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d39d3-d89c-4870-962b-f570a13d8d34 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:28.304181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:28.342546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d39d3-d89c-4870-962b-f570a13d8d34 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:28.377040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96f8c8-93ad-4547-82bf-9d4563dd13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:28.377833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96f8c8-93ad-4547-82bf-9d4563dd13a8 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:28.378117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96f8c8-93ad-4547-82bf-9d4563dd13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:28.378394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96f8c8-93ad-4547-82bf-9d4563dd13a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:28.389103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96f8c8-93ad-4547-82bf-9d4563dd13a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:28.390485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96f8c8-93ad-4547-82bf-9d4563dd13a8 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-8f96f8c8-93ad-4547-82bf-9d4563dd13a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 16:30:28.407764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:28.408935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:28.409956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 16:30:28.409956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 16:30:28.409956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 16:30:28.409956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:28.409956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 635/1283] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:28.415017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78a54e-c782-4939-8745-77e46e5e6b3e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:28.514098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78a54e-c782-4939-8745-77e46e5e6b3e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:28.548932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0fee9-9c2c-49ad-b47e-839d997363ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:28.549640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0fee9-9c2c-49ad-b47e-839d997363ff None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:28.549923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0fee9-9c2c-49ad-b47e-839d997363ff None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:28.550197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0fee9-9c2c-49ad-b47e-839d997363ff None admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:28.550911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0fee9-9c2c-49ad-b47e-839d997363ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:28.551215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0fee9-9c2c-49ad-b47e-839d997363ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:28.552623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0fee9-9c2c-49ad-b47e-839d997363ff None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:28.564816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 649/1284] 10.222.0.74 () {56 vars in 1109 bytes} [Mon May 23 16:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:28.570544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96f8c8-93ad-4547-82bf-9d4563dd13a8 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:28.668954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96f8c8-93ad-4547-82bf-9d4563dd13a8 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:28.683769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:28.703536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4f39-07e9-423c-a6bc-708328fd2bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:28.704354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4f39-07e9-423c-a6bc-708328fd2bca None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:28.704638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4f39-07e9-423c-a6bc-708328fd2bca None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:28.704916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4f39-07e9-423c-a6bc-708328fd2bca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:28.711279 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a4f39-07e9-423c-a6bc-708328fd2bca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:28.712756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a4f39-07e9-423c-a6bc-708328fd2bca None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application [None req-b35a4f39-07e9-423c-a6bc-708328fd2bca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 16:30:28.726757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application with Lock( May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:28.727819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:28.728827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:30:28.728827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:30:28.728827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:30:28.728827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:30:28.728827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:30:28.728827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:30:28.728827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 16:30:28.728827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: ERROR keystone.server.flask.application May 23 16:30:28.728827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 636/1285] 10.222.0.74 () {56 vars in 1111 bytes} [Mon May 23 16:30:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:28.734094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0fee9-9c2c-49ad-b47e-839d997363ff None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:28.786526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:28.836423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0fee9-9c2c-49ad-b47e-839d997363ff None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:28.870687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03470-0693-46c8-8ece-edc4d832cb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:28.871341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03470-0693-46c8-8ece-edc4d832cb6d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:28.871624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03470-0693-46c8-8ece-edc4d832cb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:28.871901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03470-0693-46c8-8ece-edc4d832cb6d None admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:28.872725 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03470-0693-46c8-8ece-edc4d832cb6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:28.873033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03470-0693-46c8-8ece-edc4d832cb6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:28.874468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03470-0693-46c8-8ece-edc4d832cb6d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:28.886704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 650/1286] 10.222.0.74 () {56 vars in 1148 bytes} [Mon May 23 16:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:28.894038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4f39-07e9-423c-a6bc-708328fd2bca None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:28.992370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4f39-07e9-423c-a6bc-708328fd2bca None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:29.027423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e81a86-67ed-426f-9e83-6de5a08967ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:29.028083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81a86-67ed-426f-9e83-6de5a08967ec None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:29.028564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81a86-67ed-426f-9e83-6de5a08967ec None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:29.028848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81a86-67ed-426f-9e83-6de5a08967ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:29.029683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e81a86-67ed-426f-9e83-6de5a08967ec None admin] RBAC: Adding query filter params (role.id=9940743bd8ed4e5cbb8918cc70c893ad, scope.project.id=86fcd51ba67a49918509c136e8f7d21a, user.id=a5997b3965f44d6fbdf55cccdfc52ff7) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:29.029989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e81a86-67ed-426f-9e83-6de5a08967ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:29.031428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e81a86-67ed-426f-9e83-6de5a08967ec None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:29.037284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 637/1287] 10.222.0.74 () {56 vars in 1374 bytes} [Mon May 23 16:30:28 2022] GET /identity/v3/role_assignments?user.id=a5997b3965f44d6fbdf55cccdfc52ff7&scope.project.id=86fcd51ba67a49918509c136e8f7d21a&role.id=9940743bd8ed4e5cbb8918cc70c893ad => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:31.266865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceb01b-04d7-4d82-9043-7a379291ca63 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:31.267388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceb01b-04d7-4d82-9043-7a379291ca63 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:31.267496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceb01b-04d7-4d82-9043-7a379291ca63 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:31.268812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 651/1288] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:31.274211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa699ebd-5aeb-4c0d-aa89-8ea1d18c6833 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:31.278961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa699ebd-5aeb-4c0d-aa89-8ea1d18c6833 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:31.278961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa699ebd-5aeb-4c0d-aa89-8ea1d18c6833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:31.291326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-aa699ebd-5aeb-4c0d-aa89-8ea1d18c6833 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:31.292545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-aa699ebd-5aeb-4c0d-aa89-8ea1d18c6833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:31.322147 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:31.358622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 638/1289] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:31.381428 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceb01b-04d7-4d82-9043-7a379291ca63 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:31.479854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceb01b-04d7-4d82-9043-7a379291ca63 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:31.491602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:31.515667 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4fae-d942-4cd2-b301-51bdf5483d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:31.516599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4fae-d942-4cd2-b301-51bdf5483d33 None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:31.516878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4fae-d942-4cd2-b301-51bdf5483d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:31.517147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4fae-d942-4cd2-b301-51bdf5483d33 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:31.517789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f4fae-d942-4cd2-b301-51bdf5483d33 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:31.519149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f4fae-d942-4cd2-b301-51bdf5483d33 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-776f4fae-d942-4cd2-b301-51bdf5483d33 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:31.530709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:31.532771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:31.533828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 652/1290] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:30:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:31.538010 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa699ebd-5aeb-4c0d-aa89-8ea1d18c6833 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:31.636818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa699ebd-5aeb-4c0d-aa89-8ea1d18c6833 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:31.669949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52411c8b-b16f-4d84-b930-c658df9dfbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:31.670618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52411c8b-b16f-4d84-b930-c658df9dfbca None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:31.670901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52411c8b-b16f-4d84-b930-c658df9dfbca None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:31.671177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52411c8b-b16f-4d84-b930-c658df9dfbca None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:31.671936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52411c8b-b16f-4d84-b930-c658df9dfbca None admin] RBAC: Adding query filter params (name=placement) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:31.672244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52411c8b-b16f-4d84-b930-c658df9dfbca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:31.673644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52411c8b-b16f-4d84-b930-c658df9dfbca None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:31.678491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 639/1291] 10.222.0.74 () {56 vars in 1116 bytes} [Mon May 23 16:30:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:31.684225 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4fae-d942-4cd2-b301-51bdf5483d33 None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:31.784528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4fae-d942-4cd2-b301-51bdf5483d33 None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:31.818104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7e13d-ec2e-4843-bdd5-dcc8eefcaa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:31.818761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7e13d-ec2e-4843-bdd5-dcc8eefcaa3c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:31.819049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7e13d-ec2e-4843-bdd5-dcc8eefcaa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:31.819318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7e13d-ec2e-4843-bdd5-dcc8eefcaa3c None admin] PATH_INFO: `/v3/services` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:31.820015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7e13d-ec2e-4843-bdd5-dcc8eefcaa3c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:31.820338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7e13d-ec2e-4843-bdd5-dcc8eefcaa3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:31.821707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7e13d-ec2e-4843-bdd5-dcc8eefcaa3c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:31.826185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 653/1292] 10.222.0.74 () {56 vars in 1116 bytes} [Mon May 23 16:30:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:34.031031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03def54-f301-4c5c-9fb5-0276cd5ea9e7 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:34.031571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03def54-f301-4c5c-9fb5-0276cd5ea9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:34.031571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03def54-f301-4c5c-9fb5-0276cd5ea9e7 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:34.032985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 640/1293] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:34.038169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d74d-14bd-4ffd-a4f4-d3339366d5c9 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:34.038556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d74d-14bd-4ffd-a4f4-d3339366d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:34.038737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d74d-14bd-4ffd-a4f4-d3339366d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:34.055800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7cc3d74d-14bd-4ffd-a4f4-d3339366d5c9 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:34.057025 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7cc3d74d-14bd-4ffd-a4f4-d3339366d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:34.087826 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:34.124149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 654/1294] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:34.147863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03def54-f301-4c5c-9fb5-0276cd5ea9e7 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:34.179480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:34.250235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03def54-f301-4c5c-9fb5-0276cd5ea9e7 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:34.284068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fd567-bfc4-44cf-98aa-59f86a5fa603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:34.284696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fd567-bfc4-44cf-98aa-59f86a5fa603 None admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:34.284980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fd567-bfc4-44cf-98aa-59f86a5fa603 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:34.285256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fd567-bfc4-44cf-98aa-59f86a5fa603 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:34.285976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fd567-bfc4-44cf-98aa-59f86a5fa603 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:34.287342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fd567-bfc4-44cf-98aa-59f86a5fa603 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:34.368033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 641/1295] 10.222.0.74 () {60 vars in 1141 bytes} [Mon May 23 16:30:34 2022] POST /identity/v3/services => generated 246 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:30:36.602687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c4174-227d-4afd-a4b4-e1581c03ff12 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:36.603212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c4174-227d-4afd-a4b4-e1581c03ff12 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:36.603212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c4174-227d-4afd-a4b4-e1581c03ff12 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:36.604746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 655/1296] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:36.610692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b87f0-0304-4c60-b9e5-05787e05ceae None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:36.611139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b87f0-0304-4c60-b9e5-05787e05ceae None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:36.611241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b87f0-0304-4c60-b9e5-05787e05ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:36.628347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b41b87f0-0304-4c60-b9e5-05787e05ceae None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:36.629807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b41b87f0-0304-4c60-b9e5-05787e05ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:36.704668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 642/1297] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:36.729083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c4174-227d-4afd-a4b4-e1581c03ff12 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:36.841685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c4174-227d-4afd-a4b4-e1581c03ff12 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:36.877604 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b475ef-80da-48e4-b9d5-a18a7f8d309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:36.878347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b475ef-80da-48e4-b9d5-a18a7f8d309e None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:36.878615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b475ef-80da-48e4-b9d5-a18a7f8d309e None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:36.878900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b475ef-80da-48e4-b9d5-a18a7f8d309e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:36.879840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b475ef-80da-48e4-b9d5-a18a7f8d309e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:36.881275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b475ef-80da-48e4-b9d5-a18a7f8d309e None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-e8b475ef-80da-48e4-b9d5-a18a7f8d309e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:36.895072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:36.897487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:36.898499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 656/1298] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:30:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:36.902662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b87f0-0304-4c60-b9e5-05787e05ceae None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:36.922301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:37.003818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b87f0-0304-4c60-b9e5-05787e05ceae None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:37.039289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961f696-09b6-4c78-bab5-25db14b74090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:37.039952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961f696-09b6-4c78-bab5-25db14b74090 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:37.040235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961f696-09b6-4c78-bab5-25db14b74090 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:37.040541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961f696-09b6-4c78-bab5-25db14b74090 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:37.041272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961f696-09b6-4c78-bab5-25db14b74090 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:37.041549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961f696-09b6-4c78-bab5-25db14b74090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:37.042917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961f696-09b6-4c78-bab5-25db14b74090 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:37.048785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 643/1299] 10.222.0.74 () {56 vars in 1116 bytes} [Mon May 23 16:30:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:37.054693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b475ef-80da-48e4-b9d5-a18a7f8d309e None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:37.088850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:37.159406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b475ef-80da-48e4-b9d5-a18a7f8d309e None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:37.195288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee028a-bd66-4a77-890c-daf0f6dba35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:37.195988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee028a-bd66-4a77-890c-daf0f6dba35d None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:37.196281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee028a-bd66-4a77-890c-daf0f6dba35d None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:37.196609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee028a-bd66-4a77-890c-daf0f6dba35d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:37.197408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee028a-bd66-4a77-890c-daf0f6dba35d None admin] RBAC: Adding query filter params (interface=public, service_id=6296daf443a8412888feeb7efd145861, region_id=RegionOne) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:37.197729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee028a-bd66-4a77-890c-daf0f6dba35d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:37.199115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee028a-bd66-4a77-890c-daf0f6dba35d None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:37.204919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 657/1300] 10.222.0.74 () {56 vars in 1251 bytes} [Mon May 23 16:30:37 2022] GET /identity/v3/endpoints?service_id=6296daf443a8412888feeb7efd145861&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:37.217367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961f696-09b6-4c78-bab5-25db14b74090 None admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:37.297851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:37.317158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961f696-09b6-4c78-bab5-25db14b74090 None admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:37.351124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1202102-c720-4a17-ae6c-35abce57e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:37.351782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202102-c720-4a17-ae6c-35abce57e237 None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:37.352065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202102-c720-4a17-ae6c-35abce57e237 None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:37.352432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202102-c720-4a17-ae6c-35abce57e237 None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:37.353116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202102-c720-4a17-ae6c-35abce57e237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:37.354487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202102-c720-4a17-ae6c-35abce57e237 None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:37.361562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 644/1301] 10.222.0.74 () {56 vars in 1087 bytes} [Mon May 23 16:30:37 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:30:39.657881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e236b3-938a-4262-9504-7f8c719eb3f6 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:39.658418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e236b3-938a-4262-9504-7f8c719eb3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:39.658418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e236b3-938a-4262-9504-7f8c719eb3f6 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:39.659768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 658/1302] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:30:39.665067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fadd8-8395-470b-81e0-4ead36a11ba6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:39.665487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fadd8-8395-470b-81e0-4ead36a11ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:39.665625 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fadd8-8395-470b-81e0-4ead36a11ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:39.683030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6b7fadd8-8395-470b-81e0-4ead36a11ba6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:39.684681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6b7fadd8-8395-470b-81e0-4ead36a11ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:39.755963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 645/1303] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:30:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 16:30:39.780476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e236b3-938a-4262-9504-7f8c719eb3f6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:39.880415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:39.887622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e236b3-938a-4262-9504-7f8c719eb3f6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:39.922398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5dc58-1482-44ce-bc2e-ef07e6f3256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:39.923198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5dc58-1482-44ce-bc2e-ef07e6f3256c None admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:39.923488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5dc58-1482-44ce-bc2e-ef07e6f3256c None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:39.923765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5dc58-1482-44ce-bc2e-ef07e6f3256c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:39.924503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5dc58-1482-44ce-bc2e-ef07e6f3256c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:39.925911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5dc58-1482-44ce-bc2e-ef07e6f3256c None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application [None req-0bb5dc58-1482-44ce-bc2e-ef07e6f3256c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:30:39.937898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:30:39.939135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application with Lock( May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self._enter() May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application return self.creator() May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application created_value = creator( May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: ERROR keystone.server.flask.application May 23 16:30:39.941310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 659/1304] 10.222.0.74 () {56 vars in 1117 bytes} [Mon May 23 16:30:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 16:30:39.945421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fadd8-8395-470b-81e0-4ead36a11ba6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:40.026690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:40.051700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fadd8-8395-470b-81e0-4ead36a11ba6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:40.088052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cf8e8-599f-4a34-8f83-531a55586b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:40.088749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cf8e8-599f-4a34-8f83-531a55586b4a None admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:40.089036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cf8e8-599f-4a34-8f83-531a55586b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:40.089314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cf8e8-599f-4a34-8f83-531a55586b4a None admin] PATH_INFO: `/v3/services` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:40.090048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cf8e8-599f-4a34-8f83-531a55586b4a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:30:40.090371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cf8e8-599f-4a34-8f83-531a55586b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:40.091786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cf8e8-599f-4a34-8f83-531a55586b4a None admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:40.097098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 646/1305] 10.222.0.74 () {56 vars in 1116 bytes} [Mon May 23 16:30:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:30:40.102979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5dc58-1482-44ce-bc2e-ef07e6f3256c None admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:40.209618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5dc58-1482-44ce-bc2e-ef07e6f3256c None admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:40.247868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294c3f5-03a2-4097-9b02-172356b24612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:40.248608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294c3f5-03a2-4097-9b02-172356b24612 None admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:40.248890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294c3f5-03a2-4097-9b02-172356b24612 None admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:40.249167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294c3f5-03a2-4097-9b02-172356b24612 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:40.249912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294c3f5-03a2-4097-9b02-172356b24612 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:40.251278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294c3f5-03a2-4097-9b02-172356b24612 None admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:40.356681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 660/1306] 10.222.0.74 () {60 vars in 1144 bytes} [Mon May 23 16:30:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:30:50.093931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=30 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:50.351185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:35.998183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f29aad-2324-401a-8b64-8abbfd1a91cc None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:35.998773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f29aad-2324-401a-8b64-8abbfd1a91cc None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:35.998773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f29aad-2324-401a-8b64-8abbfd1a91cc None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:36.005561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0398a8-3828-4220-bcf7-6d90757da3de None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:36.006011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0398a8-3828-4220-bcf7-6d90757da3de None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:36.006109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0398a8-3828-4220-bcf7-6d90757da3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:36.009749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 647/1307] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:36:35 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:36.080447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-da0398a8-3828-4220-bcf7-6d90757da3de None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:36.081658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-da0398a8-3828-4220-bcf7-6d90757da3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:36.204962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 661/1308] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:36:36.245300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074145d-16a4-483a-b5df-6c557138c2ab None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:36.245592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074145d-16a4-483a-b5df-6c557138c2ab None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:36.245880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074145d-16a4-483a-b5df-6c557138c2ab None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:36.247627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 648/1309] 10.222.0.74 () {54 vars in 964 bytes} [Mon May 23 16:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:36.254522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3afd84-6746-4d28-a004-de7b8121b0f4 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:36.254815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3afd84-6746-4d28-a004-de7b8121b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:36.255099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3afd84-6746-4d28-a004-de7b8121b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:36.340489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0e3afd84-6746-4d28-a004-de7b8121b0f4 None None] MFA Rules not processed for user `a833149a66af4452aeedd5d43f2fb2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:36.341815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0e3afd84-6746-4d28-a004-de7b8121b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:36.363070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:36.421889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 662/1310] 10.222.0.74 () {58 vars in 1061 bytes} [Mon May 23 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:36:36.431156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074145d-16a4-483a-b5df-6c557138c2ab None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:36:36.432944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f074145d-16a4-483a-b5df-6c557138c2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:36.575440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074145d-16a4-483a-b5df-6c557138c2ab None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:36:36.663334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981a1c8-f74f-48b9-9b63-c1e4ddccd65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:36:36.664000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a1c8-f74f-48b9-9b63-c1e4ddccd65b service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:36.664282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a1c8-f74f-48b9-9b63-c1e4ddccd65b service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:36.664586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a1c8-f74f-48b9-9b63-c1e4ddccd65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:36.666266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8981a1c8-f74f-48b9-9b63-c1e4ddccd65b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:36.728852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:36.792176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981a1c8-f74f-48b9-9b63-c1e4ddccd65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:36:36.794260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981a1c8-f74f-48b9-9b63-c1e4ddccd65b service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:36:36.815104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 649/1311] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:36:39.324961 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98508e3-5eb7-4116-baf0-e8788c8c52a2 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:39.325591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98508e3-5eb7-4116-baf0-e8788c8c52a2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:39.325591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98508e3-5eb7-4116-baf0-e8788c8c52a2 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:39.326896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 663/1312] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:39.332352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b99ba-e6d0-4298-acb4-3bd7c49de3ad None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:39.332864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b99ba-e6d0-4298-acb4-3bd7c49de3ad None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:39.332970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b99ba-e6d0-4298-acb4-3bd7c49de3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:39.414100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5a8b99ba-e6d0-4298-acb4-3bd7c49de3ad None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:39.415224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5a8b99ba-e6d0-4298-acb4-3bd7c49de3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:39.520375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 650/1313] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:36:39.558217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98508e3-5eb7-4116-baf0-e8788c8c52a2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:36:39.559943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a98508e3-5eb7-4116-baf0-e8788c8c52a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:39.673616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98508e3-5eb7-4116-baf0-e8788c8c52a2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:36:39.754007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:39.756800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a6cc3-4983-4022-8f09-e3821737d5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:36:39.757448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a6cc3-4983-4022-8f09-e3821737d5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:39.757726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a6cc3-4983-4022-8f09-e3821737d5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:39.758140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a6cc3-4983-4022-8f09-e3821737d5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:39.760301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e73a6cc3-4983-4022-8f09-e3821737d5c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:39.879790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a6cc3-4983-4022-8f09-e3821737d5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:36:39.881321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a6cc3-4983-4022-8f09-e3821737d5c5 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:36:39.900691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 664/1314] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:36:42.702630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70944-adf3-4892-b708-1935f02e2b8e None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:42.703123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70944-adf3-4892-b708-1935f02e2b8e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:42.703214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70944-adf3-4892-b708-1935f02e2b8e None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:42.705100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 651/1315] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:42.710239 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334ff77-4411-4efc-811c-4dcbedad7455 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:42.710656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334ff77-4411-4efc-811c-4dcbedad7455 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:42.710800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334ff77-4411-4efc-811c-4dcbedad7455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:42.779757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d334ff77-4411-4efc-811c-4dcbedad7455 None None] MFA Rules not processed for user `6814724561e444b7aab3949a44b38120`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:42.781017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d334ff77-4411-4efc-811c-4dcbedad7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:42.834502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:42.879423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 665/1316] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:36:42.919670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae70944-adf3-4892-b708-1935f02e2b8e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:36:42.921246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3ae70944-adf3-4892-b708-1935f02e2b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:42.930921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:43.026577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae70944-adf3-4892-b708-1935f02e2b8e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:36:43.099204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476843f-3afd-4d98-a302-9ed0faf7b2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:36:43.099787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476843f-3afd-4d98-a302-9ed0faf7b2bd service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:43.100075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476843f-3afd-4d98-a302-9ed0faf7b2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:43.100380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476843f-3afd-4d98-a302-9ed0faf7b2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:43.102028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c476843f-3afd-4d98-a302-9ed0faf7b2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:43.165791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:43.213514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476843f-3afd-4d98-a302-9ed0faf7b2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:36:43.215677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476843f-3afd-4d98-a302-9ed0faf7b2bd service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:36:43.233531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 652/1317] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:36:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:36:46.245330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a68504-2a5d-4ef4-a65e-c0638a95d103 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:46.245785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a68504-2a5d-4ef4-a65e-c0638a95d103 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:46.245945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a68504-2a5d-4ef4-a65e-c0638a95d103 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:46.247406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 666/1318] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:46.252656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee20615-494d-4b2d-86cf-e25d5e51d601 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:46.253063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee20615-494d-4b2d-86cf-e25d5e51d601 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:46.253217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee20615-494d-4b2d-86cf-e25d5e51d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:46.316819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5ee20615-494d-4b2d-86cf-e25d5e51d601 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:46.318018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5ee20615-494d-4b2d-86cf-e25d5e51d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:46.413179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 653/1319] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:36:46.451150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a68504-2a5d-4ef4-a65e-c0638a95d103 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:36:46.452722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-63a68504-2a5d-4ef4-a65e-c0638a95d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:46.554784 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a68504-2a5d-4ef4-a65e-c0638a95d103 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:36:46.629171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82109b-77aa-4a56-9b92-80ff0b34ecf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:36:46.629819 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82109b-77aa-4a56-9b92-80ff0b34ecf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:46.630103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82109b-77aa-4a56-9b92-80ff0b34ecf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:46.630382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82109b-77aa-4a56-9b92-80ff0b34ecf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:46.632024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-af82109b-77aa-4a56-9b92-80ff0b34ecf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:46.639902 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:46.742149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82109b-77aa-4a56-9b92-80ff0b34ecf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:36:46.743587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82109b-77aa-4a56-9b92-80ff0b34ecf3 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:36:46.762613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 667/1320] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:36:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:36:50.095976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188e5a9-04af-49af-9418-98d943429027 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:50.096537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188e5a9-04af-49af-9418-98d943429027 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:50.096537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188e5a9-04af-49af-9418-98d943429027 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:50.099078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 654/1321] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:50.103324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08fb5c-2ed4-4f45-b720-dbdeebc47aae None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:50.103764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08fb5c-2ed4-4f45-b720-dbdeebc47aae None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:50.103859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08fb5c-2ed4-4f45-b720-dbdeebc47aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:50.167655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6b08fb5c-2ed4-4f45-b720-dbdeebc47aae None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:50.168962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6b08fb5c-2ed4-4f45-b720-dbdeebc47aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:50.229144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:50.268479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 668/1322] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:36:50.304209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188e5a9-04af-49af-9418-98d943429027 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:36:50.305789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d188e5a9-04af-49af-9418-98d943429027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:50.328602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:50.412609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188e5a9-04af-49af-9418-98d943429027 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:36:50.484675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad47a78-d588-4e73-a74d-23d69c5f5613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:36:50.485248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad47a78-d588-4e73-a74d-23d69c5f5613 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:50.485532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad47a78-d588-4e73-a74d-23d69c5f5613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:50.485805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad47a78-d588-4e73-a74d-23d69c5f5613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:50.487452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bad47a78-d588-4e73-a74d-23d69c5f5613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:50.561392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:50.601607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad47a78-d588-4e73-a74d-23d69c5f5613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:36:50.603038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad47a78-d588-4e73-a74d-23d69c5f5613 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:36:50.621785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 655/1323] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:36:52.863038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd117c-4f41-4a9e-81ed-fe1db92a1bb6 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:52.863583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd117c-4f41-4a9e-81ed-fe1db92a1bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:52.863583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd117c-4f41-4a9e-81ed-fe1db92a1bb6 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:52.864975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 669/1324] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:52.870213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b448-75c6-4892-883b-f19eb771bf48 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:52.871212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b448-75c6-4892-883b-f19eb771bf48 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:52.871305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b448-75c6-4892-883b-f19eb771bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:52.936820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-faf0b448-75c6-4892-883b-f19eb771bf48 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:52.938019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-faf0b448-75c6-4892-883b-f19eb771bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:53.033502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 656/1325] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:36:53.069203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd117c-4f41-4a9e-81ed-fe1db92a1bb6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:36:53.070758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-34fd117c-4f41-4a9e-81ed-fe1db92a1bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:53.176257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd117c-4f41-4a9e-81ed-fe1db92a1bb6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:36:53.253485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4400229-d65d-4b27-97e0-f58daa2885bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:36:53.254128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4400229-d65d-4b27-97e0-f58daa2885bf service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:53.254406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4400229-d65d-4b27-97e0-f58daa2885bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:53.254679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4400229-d65d-4b27-97e0-f58daa2885bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:53.256321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d4400229-d65d-4b27-97e0-f58daa2885bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:53.272981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:53.364819 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4400229-d65d-4b27-97e0-f58daa2885bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:36:53.366265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4400229-d65d-4b27-97e0-f58daa2885bf service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:36:53.383856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 670/1326] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:36:55.647615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e691b-3c7b-4819-ac80-0a6547148f67 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:55.648176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e691b-3c7b-4819-ac80-0a6547148f67 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:55.648176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e691b-3c7b-4819-ac80-0a6547148f67 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:55.649746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 657/1327] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:55.654799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd738d94-edd3-4020-a845-7b8b75cb4154 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:55.655194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd738d94-edd3-4020-a845-7b8b75cb4154 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:55.655361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd738d94-edd3-4020-a845-7b8b75cb4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:55.722142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-cd738d94-edd3-4020-a845-7b8b75cb4154 None None] MFA Rules not processed for user `6814724561e444b7aab3949a44b38120`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:55.723356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cd738d94-edd3-4020-a845-7b8b75cb4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:55.790943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:55.824977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 671/1328] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:36:55.878736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d14864-8c58-422c-958d-6e0fe9433009 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:55.879030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d14864-8c58-422c-958d-6e0fe9433009 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:55.879316 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d14864-8c58-422c-958d-6e0fe9433009 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:55.880747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 658/1329] 10.222.0.74 () {54 vars in 964 bytes} [Mon May 23 16:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:55.887526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519e77b-d3cf-423c-82c0-a5b1c9885ed0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:55.887818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519e77b-d3cf-423c-82c0-a5b1c9885ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:55.888100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519e77b-d3cf-423c-82c0-a5b1c9885ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:55.968257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b519e77b-d3cf-423c-82c0-a5b1c9885ed0 None None] MFA Rules not processed for user `a833149a66af4452aeedd5d43f2fb2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:55.969514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b519e77b-d3cf-423c-82c0-a5b1c9885ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:56.051768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 672/1330] 10.222.0.74 () {58 vars in 1061 bytes} [Mon May 23 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:36:56.062016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d14864-8c58-422c-958d-6e0fe9433009 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:36:56.063623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d7d14864-8c58-422c-958d-6e0fe9433009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:56.093909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:56.166598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d14864-8c58-422c-958d-6e0fe9433009 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:36:56.243424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326205c-ed31-4607-8674-ce8e222a426b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:36:56.244070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326205c-ed31-4607-8674-ce8e222a426b service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:56.244387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326205c-ed31-4607-8674-ce8e222a426b service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:56.244667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326205c-ed31-4607-8674-ce8e222a426b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:56.246942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9326205c-ed31-4607-8674-ce8e222a426b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:56.323058 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:56.355542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326205c-ed31-4607-8674-ce8e222a426b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:36:56.359086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326205c-ed31-4607-8674-ce8e222a426b service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:36:56.382295 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 659/1331] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:36:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:36:59.439145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467189ca-9873-49a6-930a-58eb0f5a9c65 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:59.439630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467189ca-9873-49a6-930a-58eb0f5a9c65 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:59.439735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467189ca-9873-49a6-930a-58eb0f5a9c65 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:59.441111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 673/1332] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:36:59.446597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cb127-b74c-46f3-8e7c-39994885cf54 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:59.447094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cb127-b74c-46f3-8e7c-39994885cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:59.447203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cb127-b74c-46f3-8e7c-39994885cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:59.519229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-562cb127-b74c-46f3-8e7c-39994885cf54 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:36:59.520892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-562cb127-b74c-46f3-8e7c-39994885cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:59.619426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 660/1333] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:36:59.654910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467189ca-9873-49a6-930a-58eb0f5a9c65 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:36:59.656492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-467189ca-9873-49a6-930a-58eb0f5a9c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:59.728921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:59.762223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467189ca-9873-49a6-930a-58eb0f5a9c65 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:36:59.836807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e052046-86fe-43e8-b182-66cf1b85ef29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:36:59.837354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052046-86fe-43e8-b182-66cf1b85ef29 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:36:59.837639 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052046-86fe-43e8-b182-66cf1b85ef29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:36:59.837916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052046-86fe-43e8-b182-66cf1b85ef29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:36:59.840246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9e052046-86fe-43e8-b182-66cf1b85ef29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:36:59.952541 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e052046-86fe-43e8-b182-66cf1b85ef29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:36:59.954005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e052046-86fe-43e8-b182-66cf1b85ef29 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:36:59.967246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:36:59.981003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 674/1334] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:02.264219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29a76-66cf-4fb3-ae36-7ac4f91d7b27 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:02.264776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29a76-66cf-4fb3-ae36-7ac4f91d7b27 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:02.264874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29a76-66cf-4fb3-ae36-7ac4f91d7b27 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:02.266166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 661/1335] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:02.271311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccdf2d-d414-4935-9311-ea1bacaf78cd None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:02.271732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccdf2d-d414-4935-9311-ea1bacaf78cd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:02.271870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccdf2d-d414-4935-9311-ea1bacaf78cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:02.335575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9cccdf2d-d414-4935-9311-ea1bacaf78cd None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:02.336803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9cccdf2d-d414-4935-9311-ea1bacaf78cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:02.435310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 675/1336] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:02.474179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29a76-66cf-4fb3-ae36-7ac4f91d7b27 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:02.475698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-24e29a76-66cf-4fb3-ae36-7ac4f91d7b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:02.515200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:02.576929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29a76-66cf-4fb3-ae36-7ac4f91d7b27 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:02.648570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367ca1f-cce9-4622-b2a6-7ae0c3238f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:02.649237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367ca1f-cce9-4622-b2a6-7ae0c3238f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:02.649520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367ca1f-cce9-4622-b2a6-7ae0c3238f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:02.649822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367ca1f-cce9-4622-b2a6-7ae0c3238f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:02.652339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6367ca1f-cce9-4622-b2a6-7ae0c3238f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:02.734756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:02.759703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367ca1f-cce9-4622-b2a6-7ae0c3238f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:02.761120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367ca1f-cce9-4622-b2a6-7ae0c3238f72 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:02.779038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 662/1337] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:05.688377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5061afc-e54d-4cd8-a1a5-47d30da1f6c3 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:05.688922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5061afc-e54d-4cd8-a1a5-47d30da1f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:05.688922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5061afc-e54d-4cd8-a1a5-47d30da1f6c3 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:05.690338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 676/1338] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:05.695466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0030d0c-78a6-4873-8722-fc82613bf1b8 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:05.695906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0030d0c-78a6-4873-8722-fc82613bf1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:05.696029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0030d0c-78a6-4873-8722-fc82613bf1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:05.761469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b0030d0c-78a6-4873-8722-fc82613bf1b8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:05.762601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b0030d0c-78a6-4873-8722-fc82613bf1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:05.859736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 663/1339] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:05.895148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5061afc-e54d-4cd8-a1a5-47d30da1f6c3 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:05.896746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c5061afc-e54d-4cd8-a1a5-47d30da1f6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:05.972598 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:06.010465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5061afc-e54d-4cd8-a1a5-47d30da1f6c3 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:06.085514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a57ef-73d2-41c1-8f1e-07033d93a35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:06.086156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a57ef-73d2-41c1-8f1e-07033d93a35c service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:06.086436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a57ef-73d2-41c1-8f1e-07033d93a35c service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:06.086711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a57ef-73d2-41c1-8f1e-07033d93a35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:06.089477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e43a57ef-73d2-41c1-8f1e-07033d93a35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:06.199796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a57ef-73d2-41c1-8f1e-07033d93a35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:06.201256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a57ef-73d2-41c1-8f1e-07033d93a35c service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:06.220201 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 677/1340] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:10.753663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea6d26-fdfa-4ee7-9f34-8bbe6c0a67df None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:10.754227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea6d26-fdfa-4ee7-9f34-8bbe6c0a67df None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:10.754227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea6d26-fdfa-4ee7-9f34-8bbe6c0a67df None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:10.755675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 664/1341] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:10.761330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14470b62-5973-42a8-98ab-704fb3d32861 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:10.766655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14470b62-5973-42a8-98ab-704fb3d32861 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:10.766655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14470b62-5973-42a8-98ab-704fb3d32861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:10.767069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:10.814405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-14470b62-5973-42a8-98ab-704fb3d32861 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:10.815763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-14470b62-5973-42a8-98ab-704fb3d32861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:10.897294 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 678/1342] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:10.936513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea6d26-fdfa-4ee7-9f34-8bbe6c0a67df None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:10.938643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a6ea6d26-fdfa-4ee7-9f34-8bbe6c0a67df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:10.986775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:11.018478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea6d26-fdfa-4ee7-9f34-8bbe6c0a67df None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:11.022385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb13d50-c6c0-4807-a656-cd854f5d87c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:11.023029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb13d50-c6c0-4807-a656-cd854f5d87c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:11.023313 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb13d50-c6c0-4807-a656-cd854f5d87c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:11.023589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb13d50-c6c0-4807-a656-cd854f5d87c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:11.033283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb13d50-c6c0-4807-a656-cd854f5d87c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:11.034715 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb13d50-c6c0-4807-a656-cd854f5d87c8 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:11.044219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 665/1343] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:14.373035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4f483-822d-4760-afc5-9ccc864ce9cd None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:14.373566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4f483-822d-4760-afc5-9ccc864ce9cd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:14.373689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4f483-822d-4760-afc5-9ccc864ce9cd None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:14.374977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 679/1344] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:14.380316 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aeed6-3bf2-457b-be9c-37208f96d0b6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:14.380754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aeed6-3bf2-457b-be9c-37208f96d0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:14.380905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aeed6-3bf2-457b-be9c-37208f96d0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:14.409246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d45aeed6-3bf2-457b-be9c-37208f96d0b6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:14.410445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d45aeed6-3bf2-457b-be9c-37208f96d0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:14.418954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 666/1345] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:14.455207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4f483-822d-4760-afc5-9ccc864ce9cd None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:14.456931 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3eb4f483-822d-4760-afc5-9ccc864ce9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:14.471231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4f483-822d-4760-afc5-9ccc864ce9cd None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:14.474794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84ff69-f754-49a9-8ea7-cb42158ca9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:14.475439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84ff69-f754-49a9-8ea7-cb42158ca9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:14.475726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84ff69-f754-49a9-8ea7-cb42158ca9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:14.476006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84ff69-f754-49a9-8ea7-cb42158ca9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:14.486604 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84ff69-f754-49a9-8ea7-cb42158ca9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:14.488124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84ff69-f754-49a9-8ea7-cb42158ca9e0 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:14.498249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 680/1346] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:19.262741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100ab8-a1d6-42e8-bca6-8d14ad1526e6 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:19.263257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100ab8-a1d6-42e8-bca6-8d14ad1526e6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:19.263351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100ab8-a1d6-42e8-bca6-8d14ad1526e6 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:19.264910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 667/1347] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:19.269939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc634-29cc-4e14-8095-e9330c1fad48 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:19.270344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc634-29cc-4e14-8095-e9330c1fad48 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:19.270497 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc634-29cc-4e14-8095-e9330c1fad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:19.288903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-bddfc634-29cc-4e14-8095-e9330c1fad48 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:19.290083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-bddfc634-29cc-4e14-8095-e9330c1fad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:19.297953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 681/1348] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:19.335516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22100ab8-a1d6-42e8-bca6-8d14ad1526e6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:19.347013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22100ab8-a1d6-42e8-bca6-8d14ad1526e6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:19.350453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432888-ad34-4ea8-ad7d-25a10465446d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:19.351084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432888-ad34-4ea8-ad7d-25a10465446d service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:19.351363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432888-ad34-4ea8-ad7d-25a10465446d service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:19.351634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432888-ad34-4ea8-ad7d-25a10465446d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:19.361198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd432888-ad34-4ea8-ad7d-25a10465446d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:19.362666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd432888-ad34-4ea8-ad7d-25a10465446d service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:19.373606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 668/1349] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:24.744875 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abc761-149f-4b99-982c-56b062d2b858 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:24.745852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abc761-149f-4b99-982c-56b062d2b858 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:24.746316 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abc761-149f-4b99-982c-56b062d2b858 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:24.751461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 682/1350] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:37:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:24.757496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3176a9-595e-4d28-90f1-783b751a827e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:24.758442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3176a9-595e-4d28-90f1-783b751a827e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:24.759451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3176a9-595e-4d28-90f1-783b751a827e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:24.849252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-4f3176a9-595e-4d28-90f1-783b751a827e None None] MFA Rules not processed for user `a5997b3965f44d6fbdf55cccdfc52ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:24.850762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4f3176a9-595e-4d28-90f1-783b751a827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:24.952193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 669/1351] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:29.283397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=52 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:29.306224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542e2a-ba69-43d5-87ef-652c2064e302 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:29.306475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542e2a-ba69-43d5-87ef-652c2064e302 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:29.306743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542e2a-ba69-43d5-87ef-652c2064e302 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:29.308282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 683/1352] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:29.313922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19ff8-6623-4c55-8af0-724e487ef5da None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:29.314437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19ff8-6623-4c55-8af0-724e487ef5da None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:29.314711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19ff8-6623-4c55-8af0-724e487ef5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:29.334801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7ec19ff8-6623-4c55-8af0-724e487ef5da None None] MFA Rules not processed for user `a5997b3965f44d6fbdf55cccdfc52ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:29.336225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7ec19ff8-6623-4c55-8af0-724e487ef5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:29.346195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 670/1353] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:37:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:30.767274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0730-4862-46b8-ba97-0edae818f43c None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:30.767838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0730-4862-46b8-ba97-0edae818f43c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:30.767838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0730-4862-46b8-ba97-0edae818f43c None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:30.769295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 684/1354] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:30.774901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cf9a5-fd16-4902-a012-7ebf2c556336 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:30.775359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cf9a5-fd16-4902-a012-7ebf2c556336 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:30.775523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cf9a5-fd16-4902-a012-7ebf2c556336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:30.794269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2f3cf9a5-fd16-4902-a012-7ebf2c556336 None None] MFA Rules not processed for user `a5997b3965f44d6fbdf55cccdfc52ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:30.795507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2f3cf9a5-fd16-4902-a012-7ebf2c556336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:30.804013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 671/1355] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:34.886970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894bb6-f779-447b-9e8a-385c7918e2ee None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:34.887566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894bb6-f779-447b-9e8a-385c7918e2ee None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:34.887566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894bb6-f779-447b-9e8a-385c7918e2ee None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:34.888994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 685/1356] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:34.894390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475054-9cc2-4777-b4ae-9826e3d69dd5 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:34.894812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475054-9cc2-4777-b4ae-9826e3d69dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:34.894953 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475054-9cc2-4777-b4ae-9826e3d69dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:34.913654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a5475054-9cc2-4777-b4ae-9826e3d69dd5 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:34.915719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a5475054-9cc2-4777-b4ae-9826e3d69dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:34.928667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 672/1357] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:34.985493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ba79f-dbd8-4971-aa57-16788c97c56a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:34.986339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ba79f-dbd8-4971-aa57-16788c97c56a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:34.986883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ba79f-dbd8-4971-aa57-16788c97c56a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:34.988504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 686/1358] 10.222.0.74 () {54 vars in 961 bytes} [Mon May 23 16:37:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:34.998213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d56b-f3ae-4891-bb02-d5b8e4d2dcb0 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:34.998728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d56b-f3ae-4891-bb02-d5b8e4d2dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:34.999280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d56b-f3ae-4891-bb02-d5b8e4d2dcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:35.039303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:35.064053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6b06d56b-f3ae-4891-bb02-d5b8e4d2dcb0 None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:35.065430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6b06d56b-f3ae-4891-bb02-d5b8e4d2dcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:35.148644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 673/1359] 10.222.0.74 () {58 vars in 1058 bytes} [Mon May 23 16:37:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:35.162751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ba79f-dbd8-4971-aa57-16788c97c56a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:35.179218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ba79f-dbd8-4971-aa57-16788c97c56a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:35.185483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa626a8f-c6e9-4b1c-8c1e-754bd94d8e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:35.186209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626a8f-c6e9-4b1c-8c1e-754bd94d8e45 service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:35.186569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626a8f-c6e9-4b1c-8c1e-754bd94d8e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:35.186921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626a8f-c6e9-4b1c-8c1e-754bd94d8e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:35.200507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa626a8f-c6e9-4b1c-8c1e-754bd94d8e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:35.203014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa626a8f-c6e9-4b1c-8c1e-754bd94d8e45 service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:35.223629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 687/1360] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:37.675885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c71fa6-af9c-44aa-abba-c3782ffca206 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:37.676470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c71fa6-af9c-44aa-abba-c3782ffca206 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:37.676470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c71fa6-af9c-44aa-abba-c3782ffca206 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:37.678188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 674/1361] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:37.683895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c37a-91fa-4eba-9462-1fc4a896821f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:37.684383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c37a-91fa-4eba-9462-1fc4a896821f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:37.684595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c37a-91fa-4eba-9462-1fc4a896821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:37.703614 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-5994c37a-91fa-4eba-9462-1fc4a896821f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:37.704908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5994c37a-91fa-4eba-9462-1fc4a896821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:37.716330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 688/1362] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:37.759405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c71fa6-af9c-44aa-abba-c3782ffca206 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:37.775588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c71fa6-af9c-44aa-abba-c3782ffca206 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:37.781537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a96a6-678b-4b05-b11a-6f40416ced90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:37.782380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a96a6-678b-4b05-b11a-6f40416ced90 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:37.782820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a96a6-678b-4b05-b11a-6f40416ced90 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:37.783258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a96a6-678b-4b05-b11a-6f40416ced90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:37.796230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a96a6-678b-4b05-b11a-6f40416ced90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:37.798081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a96a6-678b-4b05-b11a-6f40416ced90 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:37.809743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 675/1363] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:40.549015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32cc0-146e-442d-958a-e9ba798aebb2 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:40.550045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32cc0-146e-442d-958a-e9ba798aebb2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:40.550546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32cc0-146e-442d-958a-e9ba798aebb2 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:40.552458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 689/1364] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:40.558835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca7520-8363-45d6-9daa-f7a92a2ef0ec None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:40.559776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca7520-8363-45d6-9daa-f7a92a2ef0ec None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:40.560266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca7520-8363-45d6-9daa-f7a92a2ef0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:40.580349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5dca7520-8363-45d6-9daa-f7a92a2ef0ec None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:40.581468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5dca7520-8363-45d6-9daa-f7a92a2ef0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:40.590303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 676/1365] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:40.636396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f80a-303b-4ba5-9647-596d0c2a6610 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:40.636683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f80a-303b-4ba5-9647-596d0c2a6610 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:40.637314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f80a-303b-4ba5-9647-596d0c2a6610 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:40.638568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 690/1366] 10.222.0.74 () {54 vars in 961 bytes} [Mon May 23 16:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:40.644538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa10327-21d8-4dce-9960-ceea8f5ecae4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:40.644834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa10327-21d8-4dce-9960-ceea8f5ecae4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:40.645147 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa10327-21d8-4dce-9960-ceea8f5ecae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:40.663918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6fa10327-21d8-4dce-9960-ceea8f5ecae4 None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:40.665902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6fa10327-21d8-4dce-9960-ceea8f5ecae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:40.675113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 677/1367] 10.222.0.74 () {58 vars in 1058 bytes} [Mon May 23 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:40.683370 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510f80a-303b-4ba5-9647-596d0c2a6610 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:40.697729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510f80a-303b-4ba5-9647-596d0c2a6610 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:40.703119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6a5e6-09f2-47c3-a1cc-0e2251acb120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:40.703829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6a5e6-09f2-47c3-a1cc-0e2251acb120 service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:40.704108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6a5e6-09f2-47c3-a1cc-0e2251acb120 service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:40.704403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6a5e6-09f2-47c3-a1cc-0e2251acb120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:40.713500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6a5e6-09f2-47c3-a1cc-0e2251acb120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:40.720518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6a5e6-09f2-47c3-a1cc-0e2251acb120 service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:40.727776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 691/1368] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:37:43.151642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed449ba-637a-4729-8d99-0cf8d61dfffd None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:43.152222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed449ba-637a-4729-8d99-0cf8d61dfffd None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:43.152222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed449ba-637a-4729-8d99-0cf8d61dfffd None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:43.153945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 678/1369] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:43.159546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a425eb-1350-467f-ade8-9eac3f1c474b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:43.160056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a425eb-1350-467f-ade8-9eac3f1c474b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:43.160150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a425eb-1350-467f-ade8-9eac3f1c474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:43.178734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-08a425eb-1350-467f-ade8-9eac3f1c474b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:43.180484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-08a425eb-1350-467f-ade8-9eac3f1c474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:43.188685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 692/1370] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:43.245673 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed449ba-637a-4729-8d99-0cf8d61dfffd None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:43.261367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed449ba-637a-4729-8d99-0cf8d61dfffd None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:43.267033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fd598-0f75-429b-9766-6989d7330674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:43.267697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fd598-0f75-429b-9766-6989d7330674 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:43.267980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fd598-0f75-429b-9766-6989d7330674 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:43.268253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fd598-0f75-429b-9766-6989d7330674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:43.278049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fd598-0f75-429b-9766-6989d7330674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:43.279682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fd598-0f75-429b-9766-6989d7330674 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:43.291963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 679/1371] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:43.345606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aeac6-0eb9-46a5-b86a-fe712617aeeb None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:43.345898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aeac6-0eb9-46a5-b86a-fe712617aeeb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:43.346186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aeac6-0eb9-46a5-b86a-fe712617aeeb None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:43.347602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 693/1372] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:43.353951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9298f-2708-4321-9fb6-a7dc07ba0ee6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:43.354246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9298f-2708-4321-9fb6-a7dc07ba0ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:43.354529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9298f-2708-4321-9fb6-a7dc07ba0ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:43.373428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a0f9298f-2708-4321-9fb6-a7dc07ba0ee6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:43.374644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a0f9298f-2708-4321-9fb6-a7dc07ba0ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:43.382638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 680/1373] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:43.687246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecf8e9-4902-4a69-ba04-6781667050a2 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:43.688032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecf8e9-4902-4a69-ba04-6781667050a2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:43.688423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecf8e9-4902-4a69-ba04-6781667050a2 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:43.690315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 694/1374] 10.222.0.74 () {54 vars in 963 bytes} [Mon May 23 16:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:43.698620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252242-cadd-4273-9573-3982b7896c67 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:43.698919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252242-cadd-4273-9573-3982b7896c67 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:43.699361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252242-cadd-4273-9573-3982b7896c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:43.763113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-35252242-cadd-4273-9573-3982b7896c67 None None] MFA Rules not processed for user `6d377792af1c4ad19519e2e98bac72e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:43.764389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-35252242-cadd-4273-9573-3982b7896c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:43.837727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 681/1375] 10.222.0.74 () {58 vars in 1060 bytes} [Mon May 23 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:43.845473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecf8e9-4902-4a69-ba04-6781667050a2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:43.861600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecf8e9-4902-4a69-ba04-6781667050a2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:43.865986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a646f-d637-4e7c-ac7b-6dba2d5de625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:43.866987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a646f-d637-4e7c-ac7b-6dba2d5de625 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:43.867535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a646f-d637-4e7c-ac7b-6dba2d5de625 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:43.869290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a646f-d637-4e7c-ac7b-6dba2d5de625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:43.882001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a646f-d637-4e7c-ac7b-6dba2d5de625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:43.883644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a646f-d637-4e7c-ac7b-6dba2d5de625 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:43.895535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 695/1376] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:45.761613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2651a7-1b85-44be-9d52-0bfab11b21a0 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:45.762155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2651a7-1b85-44be-9d52-0bfab11b21a0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:45.762155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2651a7-1b85-44be-9d52-0bfab11b21a0 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:45.763630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 682/1377] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:45.769642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602697-576c-4c5e-85fe-8485fc3f7d85 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:45.770159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602697-576c-4c5e-85fe-8485fc3f7d85 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:45.770369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602697-576c-4c5e-85fe-8485fc3f7d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:45.791655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-fd602697-576c-4c5e-85fe-8485fc3f7d85 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:45.792973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fd602697-576c-4c5e-85fe-8485fc3f7d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:45.801441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 696/1378] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:45.851651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2651a7-1b85-44be-9d52-0bfab11b21a0 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:45.867730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2651a7-1b85-44be-9d52-0bfab11b21a0 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:45.873847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3115e-22b8-4c68-9020-84aa277fae7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:45.874559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3115e-22b8-4c68-9020-84aa277fae7c service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:45.874847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3115e-22b8-4c68-9020-84aa277fae7c service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:45.875125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3115e-22b8-4c68-9020-84aa277fae7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:45.880738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:45.885947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3115e-22b8-4c68-9020-84aa277fae7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:45.887585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3115e-22b8-4c68-9020-84aa277fae7c service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:45.898452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 683/1379] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:48.286530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d0cfe-2fa5-4456-9fb2-d12ccdc687a5 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:48.287094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d0cfe-2fa5-4456-9fb2-d12ccdc687a5 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:48.287308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d0cfe-2fa5-4456-9fb2-d12ccdc687a5 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:48.291695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 697/1380] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:48.294809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16859bf-0da9-4a95-9bc7-7b8633bbc775 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:48.295604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16859bf-0da9-4a95-9bc7-7b8633bbc775 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:48.295889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16859bf-0da9-4a95-9bc7-7b8633bbc775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:48.313476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a16859bf-0da9-4a95-9bc7-7b8633bbc775 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:48.314664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a16859bf-0da9-4a95-9bc7-7b8633bbc775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:48.322620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 684/1381] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:48.366017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d0cfe-2fa5-4456-9fb2-d12ccdc687a5 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:48.381247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d0cfe-2fa5-4456-9fb2-d12ccdc687a5 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:48.387478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307aee4-2124-4fdc-ab84-210b5be59566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:48.388254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307aee4-2124-4fdc-ab84-210b5be59566 service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:48.388674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307aee4-2124-4fdc-ab84-210b5be59566 service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:48.389055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307aee4-2124-4fdc-ab84-210b5be59566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:48.397757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307aee4-2124-4fdc-ab84-210b5be59566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:48.399482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307aee4-2124-4fdc-ab84-210b5be59566 service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:48.409261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 698/1382] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:50.863309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd7201-018c-442b-bee2-7e0547f9f202 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:50.864229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd7201-018c-442b-bee2-7e0547f9f202 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:50.864548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd7201-018c-442b-bee2-7e0547f9f202 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:50.865940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 685/1383] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:50.871937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8922a-e16a-4799-b436-20627ac7fbf3 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:50.872531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8922a-e16a-4799-b436-20627ac7fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:50.872531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8922a-e16a-4799-b436-20627ac7fbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:50.894443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-cfa8922a-e16a-4799-b436-20627ac7fbf3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:50.895638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cfa8922a-e16a-4799-b436-20627ac7fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:50.904161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 699/1384] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:50.949823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd7201-018c-442b-bee2-7e0547f9f202 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:50.965149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd7201-018c-442b-bee2-7e0547f9f202 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:50.970768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3fb25-505c-4fc1-91d0-0cb4615604f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:50.971424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3fb25-505c-4fc1-91d0-0cb4615604f5 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:50.971717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3fb25-505c-4fc1-91d0-0cb4615604f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:50.971995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3fb25-505c-4fc1-91d0-0cb4615604f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:50.981716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3fb25-505c-4fc1-91d0-0cb4615604f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:50.983358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3fb25-505c-4fc1-91d0-0cb4615604f5 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:50.994159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 686/1385] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:53.245883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e877d52-999e-4be3-bf18-22c11af6013e None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:53.246560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e877d52-999e-4be3-bf18-22c11af6013e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:53.246560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e877d52-999e-4be3-bf18-22c11af6013e None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:53.247796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 700/1386] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:53.253354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ed41-3c27-4f6e-9c41-cb904f5d36e2 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:53.253886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ed41-3c27-4f6e-9c41-cb904f5d36e2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:53.253996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ed41-3c27-4f6e-9c41-cb904f5d36e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:53.272785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d613ed41-3c27-4f6e-9c41-cb904f5d36e2 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:53.274752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d613ed41-3c27-4f6e-9c41-cb904f5d36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:53.283254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 687/1387] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:53.329724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e877d52-999e-4be3-bf18-22c11af6013e None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:53.348026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e877d52-999e-4be3-bf18-22c11af6013e None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:53.355186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ef2c4-09bc-427a-a2f8-11bd62981f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:53.356351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef2c4-09bc-427a-a2f8-11bd62981f7d service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:53.356782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef2c4-09bc-427a-a2f8-11bd62981f7d service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:53.357144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef2c4-09bc-427a-a2f8-11bd62981f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:53.368434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ef2c4-09bc-427a-a2f8-11bd62981f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:53.370676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ef2c4-09bc-427a-a2f8-11bd62981f7d service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:53.382205 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 701/1388] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:55.959559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9cea-c8df-4138-aa16-c5749e05f1ab None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:55.959972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9cea-c8df-4138-aa16-c5749e05f1ab None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:55.960783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9cea-c8df-4138-aa16-c5749e05f1ab None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:55.962934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 688/1389] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:55.968421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4a021-68da-45ed-9f2b-12cd3d9b246f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:55.968877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4a021-68da-45ed-9f2b-12cd3d9b246f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:55.968974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4a021-68da-45ed-9f2b-12cd3d9b246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:55.987759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-fcf4a021-68da-45ed-9f2b-12cd3d9b246f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:55.989040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fcf4a021-68da-45ed-9f2b-12cd3d9b246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:55.997088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 702/1390] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:56.043434 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9cea-c8df-4138-aa16-c5749e05f1ab None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:56.058254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9cea-c8df-4138-aa16-c5749e05f1ab None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:56.063518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d30eab-05d3-4b4c-92a0-a524e9365a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:56.064145 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d30eab-05d3-4b4c-92a0-a524e9365a07 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:56.064453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d30eab-05d3-4b4c-92a0-a524e9365a07 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:56.064725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d30eab-05d3-4b4c-92a0-a524e9365a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:56.073473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d30eab-05d3-4b4c-92a0-a524e9365a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:56.075037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d30eab-05d3-4b4c-92a0-a524e9365a07 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:56.084461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 689/1391] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:37:58.475084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a288-33c2-4039-8904-312711cada6f None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:58.476198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a288-33c2-4039-8904-312711cada6f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:58.476198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a288-33c2-4039-8904-312711cada6f None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:58.478092 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 703/1392] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:37:58.483841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda3d26-6a84-45ee-8be9-43acee315ea2 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:58.484322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda3d26-6a84-45ee-8be9-43acee315ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:58.484546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda3d26-6a84-45ee-8be9-43acee315ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:58.502999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-efda3d26-6a84-45ee-8be9-43acee315ea2 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:37:58.504263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-efda3d26-6a84-45ee-8be9-43acee315ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:37:58.513351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 690/1393] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:37:58.556322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964a288-33c2-4039-8904-312711cada6f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:37:58.570813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964a288-33c2-4039-8904-312711cada6f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:37:58.576186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971f1af-a6e9-47fa-805b-f0d71032e084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:37:58.576861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971f1af-a6e9-47fa-805b-f0d71032e084 service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:37:58.577143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971f1af-a6e9-47fa-805b-f0d71032e084 service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:37:58.577419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971f1af-a6e9-47fa-805b-f0d71032e084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:37:58.586090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971f1af-a6e9-47fa-805b-f0d71032e084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:37:58.587669 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971f1af-a6e9-47fa-805b-f0d71032e084 service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:37:58.597194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 704/1394] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:00.178714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c22142-dee8-4310-b4a5-0a69a17ee97d None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:00.179473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c22142-dee8-4310-b4a5-0a69a17ee97d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:00.179473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c22142-dee8-4310-b4a5-0a69a17ee97d None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:00.180689 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 691/1395] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:00.186000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7ba69-1af3-4366-98e6-cac7002a546a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:00.186435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7ba69-1af3-4366-98e6-cac7002a546a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:00.186719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7ba69-1af3-4366-98e6-cac7002a546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:00.192924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=52 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:38:00.205097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-75b7ba69-1af3-4366-98e6-cac7002a546a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:00.211618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-75b7ba69-1af3-4366-98e6-cac7002a546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:00.215035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 705/1396] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:00.270550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68a29a-ea3f-4407-909b-597470418f60 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:00.270841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68a29a-ea3f-4407-909b-597470418f60 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:00.271120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68a29a-ea3f-4407-909b-597470418f60 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:00.273062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 692/1397] 10.222.0.74 () {54 vars in 962 bytes} [Mon May 23 16:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:00.278037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae658-4f45-48fe-ac33-d3c5e72c40da None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:00.278418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae658-4f45-48fe-ac33-d3c5e72c40da None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:00.278744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae658-4f45-48fe-ac33-d3c5e72c40da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:00.327918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-f7bae658-4f45-48fe-ac33-d3c5e72c40da None None] MFA Rules not processed for user `e9533e8371e64161a4c54eeab867a17e`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:00.329152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f7bae658-4f45-48fe-ac33-d3c5e72c40da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:00.389232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 706/1398] 10.222.0.74 () {58 vars in 1059 bytes} [Mon May 23 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:00.396817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68a29a-ea3f-4407-909b-597470418f60 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:00.407349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68a29a-ea3f-4407-909b-597470418f60 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:00.410923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8bf7d-7f8c-4b4a-a586-132994c8e64c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9533e8371e64161a4c54eeab867a17e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:00.411553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8bf7d-7f8c-4b4a-a586-132994c8e64c service glance] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:00.411839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8bf7d-7f8c-4b4a-a586-132994c8e64c service glance] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:00.412113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8bf7d-7f8c-4b4a-a586-132994c8e64c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:00.421198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8bf7d-7f8c-4b4a-a586-132994c8e64c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:00.422632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8bf7d-7f8c-4b4a-a586-132994c8e64c service glance] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:00.432844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 693/1399] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:38:01.220545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31874f0-b826-43ce-9ab6-400c51e3abab None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:01.221012 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31874f0-b826-43ce-9ab6-400c51e3abab None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:01.221698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31874f0-b826-43ce-9ab6-400c51e3abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:01.229205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e5b8a-074c-433b-849c-f4cdcae1cf1c None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:01.229684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e5b8a-074c-433b-849c-f4cdcae1cf1c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:01.229782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e5b8a-074c-433b-849c-f4cdcae1cf1c None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:01.231394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 694/1400] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:01.236381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821b44-1ba2-40e9-bfb7-df87c7d29df2 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:01.263395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821b44-1ba2-40e9-bfb7-df87c7d29df2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:01.263395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821b44-1ba2-40e9-bfb7-df87c7d29df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:01.263395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-16821b44-1ba2-40e9-bfb7-df87c7d29df2 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:01.263395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-16821b44-1ba2-40e9-bfb7-df87c7d29df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:01.264394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 695/1401] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:38:01.276421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c31874f0-b826-43ce-9ab6-400c51e3abab None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:01.277625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c31874f0-b826-43ce-9ab6-400c51e3abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:01.310449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821b44-1ba2-40e9-bfb7-df87c7d29df2 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:01.322836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821b44-1ba2-40e9-bfb7-df87c7d29df2 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:01.328179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b81c3-a0ff-4fb5-ac18-87f838deaffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:01.328840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b81c3-a0ff-4fb5-ac18-87f838deaffc service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:01.329122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b81c3-a0ff-4fb5-ac18-87f838deaffc service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:01.329396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b81c3-a0ff-4fb5-ac18-87f838deaffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:01.337850 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b81c3-a0ff-4fb5-ac18-87f838deaffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:01.339417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b81c3-a0ff-4fb5-ac18-87f838deaffc service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:01.346584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 707/1402] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:01.349236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 696/1403] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:38:01.389318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28a6de-5d02-430a-9b26-8353b5063ef3 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:01.389611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28a6de-5d02-430a-9b26-8353b5063ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:01.389894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28a6de-5d02-430a-9b26-8353b5063ef3 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:01.391382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 708/1404] 10.222.0.74 () {54 vars in 942 bytes} [Mon May 23 16:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:01.397991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf41bc-4765-4010-9832-f5754d11cebb None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:01.419227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf41bc-4765-4010-9832-f5754d11cebb None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:01.419227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf41bc-4765-4010-9832-f5754d11cebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:01.447348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-31cf41bc-4765-4010-9832-f5754d11cebb None None] MFA Rules not processed for user `45f676694ec24de2a5c755e217baed87`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:01.448592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-31cf41bc-4765-4010-9832-f5754d11cebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:01.523045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 697/1405] 10.222.0.74 () {58 vars in 1039 bytes} [Mon May 23 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:01.534627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28a6de-5d02-430a-9b26-8353b5063ef3 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:01.546360 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28a6de-5d02-430a-9b26-8353b5063ef3 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:01.551295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb74c-2a3a-4477-bcc5-618be2a2afa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:01.551925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb74c-2a3a-4477-bcc5-618be2a2afa1 service swift] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:01.552204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb74c-2a3a-4477-bcc5-618be2a2afa1 service swift] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:01.552506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb74c-2a3a-4477-bcc5-618be2a2afa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:01.561263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb74c-2a3a-4477-bcc5-618be2a2afa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:01.568242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb74c-2a3a-4477-bcc5-618be2a2afa1 service swift] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:01.571342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 709/1406] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:38:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:38:03.962700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60af7e-4bae-480b-be2b-d914c7b8663a None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:03.963076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60af7e-4bae-480b-be2b-d914c7b8663a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:03.963229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60af7e-4bae-480b-be2b-d914c7b8663a None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:03.969381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 698/1407] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:38:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:03.970914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c384ea-0e6b-4e6f-be27-23c4e7b2927e None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:03.971402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c384ea-0e6b-4e6f-be27-23c4e7b2927e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:03.971491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c384ea-0e6b-4e6f-be27-23c4e7b2927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:03.997987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a4c384ea-0e6b-4e6f-be27-23c4e7b2927e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:03.999226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a4c384ea-0e6b-4e6f-be27-23c4e7b2927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:04.007557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 710/1408] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:04.054573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60af7e-4bae-480b-be2b-d914c7b8663a None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:04.072562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60af7e-4bae-480b-be2b-d914c7b8663a None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:04.078192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743befdb-8486-4cce-a859-c91397d9a3d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:04.078992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743befdb-8486-4cce-a859-c91397d9a3d8 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:04.079385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743befdb-8486-4cce-a859-c91397d9a3d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:04.079763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743befdb-8486-4cce-a859-c91397d9a3d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:04.090213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743befdb-8486-4cce-a859-c91397d9a3d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:04.091939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743befdb-8486-4cce-a859-c91397d9a3d8 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:04.106231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 699/1409] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:14.299297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:38:14.300744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:38:27.033896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5a505-7495-48d1-b313-42c2b3a6209e None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:27.034472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5a505-7495-48d1-b313-42c2b3a6209e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:27.034472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5a505-7495-48d1-b313-42c2b3a6209e None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:27.035787 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 711/1410] 10.222.0.74 () {54 vars in 918 bytes} [Mon May 23 16:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:27.041515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75731669-5756-4dd8-b3bb-3ff2a0ac9a33 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:27.041919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75731669-5756-4dd8-b3bb-3ff2a0ac9a33 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:27.042070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75731669-5756-4dd8-b3bb-3ff2a0ac9a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:27.060319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-75731669-5756-4dd8-b3bb-3ff2a0ac9a33 None None] MFA Rules not processed for user `a5997b3965f44d6fbdf55cccdfc52ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:27.061506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-75731669-5756-4dd8-b3bb-3ff2a0ac9a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:27.069909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 700/1411] 10.222.0.74 () {58 vars in 1015 bytes} [Mon May 23 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:27.084121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79dfa-58fd-4e10-9913-b93e13373666 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:27.084447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79dfa-58fd-4e10-9913-b93e13373666 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:27.084730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79dfa-58fd-4e10-9913-b93e13373666 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:27.086072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 712/1412] 10.222.0.74 () {54 vars in 918 bytes} [Mon May 23 16:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:27.090545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade38f-20b8-41ad-a676-b4fc963a9cff None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:27.090837 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade38f-20b8-41ad-a676-b4fc963a9cff None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:27.091119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade38f-20b8-41ad-a676-b4fc963a9cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:27.109592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-55ade38f-20b8-41ad-a676-b4fc963a9cff None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:27.110815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-55ade38f-20b8-41ad-a676-b4fc963a9cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:27.119948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 701/1413] 10.222.0.74 () {58 vars in 1015 bytes} [Mon May 23 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:38:29.924810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11def204-6137-4a92-adeb-18a17456157a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:29.925350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11def204-6137-4a92-adeb-18a17456157a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:29.925350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11def204-6137-4a92-adeb-18a17456157a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:29.926795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:29.932181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2d297-adb9-4989-8f70-6e440d98bb29 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:29.932596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2d297-adb9-4989-8f70-6e440d98bb29 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:29.932787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2d297-adb9-4989-8f70-6e440d98bb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:29.950665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c7f2d297-adb9-4989-8f70-6e440d98bb29 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:29.951856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c7f2d297-adb9-4989-8f70-6e440d98bb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:29.960229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:30.002705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11def204-6137-4a92-adeb-18a17456157a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:30.017877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11def204-6137-4a92-adeb-18a17456157a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:30.024768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ebdfa-8955-4b58-be7a-4177b8d79afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:30.025411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ebdfa-8955-4b58-be7a-4177b8d79afd service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:30.025698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ebdfa-8955-4b58-be7a-4177b8d79afd service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:30.026000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ebdfa-8955-4b58-be7a-4177b8d79afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:30.034176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ebdfa-8955-4b58-be7a-4177b8d79afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:30.035778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ebdfa-8955-4b58-be7a-4177b8d79afd service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:30.045871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 714/1416] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:31.028031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140273e-8577-4d8c-ad86-8ebb5463a977 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:31.028667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140273e-8577-4d8c-ad86-8ebb5463a977 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:31.028667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140273e-8577-4d8c-ad86-8ebb5463a977 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:31.030008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:31.034954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba772-8956-4ce7-8c23-0149862f7f8c None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:31.035358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba772-8956-4ce7-8c23-0149862f7f8c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:31.035516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba772-8956-4ce7-8c23-0149862f7f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:31.054052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2a7ba772-8956-4ce7-8c23-0149862f7f8c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:31.055244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2a7ba772-8956-4ce7-8c23-0149862f7f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:31.063044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:31.265200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140273e-8577-4d8c-ad86-8ebb5463a977 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:31.281416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140273e-8577-4d8c-ad86-8ebb5463a977 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:31.285457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23894363-5359-43e7-a74b-47e765315a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:31.286164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23894363-5359-43e7-a74b-47e765315a55 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:31.286486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23894363-5359-43e7-a74b-47e765315a55 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:31.286813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23894363-5359-43e7-a74b-47e765315a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:31.295143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23894363-5359-43e7-a74b-47e765315a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:31.296772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23894363-5359-43e7-a74b-47e765315a55 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:31.306164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 704/1419] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:32.233555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3613224-8c34-4ba2-ba2d-1456ba3d78d9 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:32.234036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3613224-8c34-4ba2-ba2d-1456ba3d78d9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:32.234036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3613224-8c34-4ba2-ba2d-1456ba3d78d9 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:32.235460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:32.240994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c25e-57c0-4864-9ed1-00284a6a9acf None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:32.241410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c25e-57c0-4864-9ed1-00284a6a9acf None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:32.241561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c25e-57c0-4864-9ed1-00284a6a9acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:32.260917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-70d5c25e-57c0-4864-9ed1-00284a6a9acf None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:32.262187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-70d5c25e-57c0-4864-9ed1-00284a6a9acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:32.269986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:32.419019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3613224-8c34-4ba2-ba2d-1456ba3d78d9 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:32.433508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3613224-8c34-4ba2-ba2d-1456ba3d78d9 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:32.439052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ca8bd-c56a-4cb7-9f8a-8eab7c9f3912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:32.439691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ca8bd-c56a-4cb7-9f8a-8eab7c9f3912 service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:32.439971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ca8bd-c56a-4cb7-9f8a-8eab7c9f3912 service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:32.440248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ca8bd-c56a-4cb7-9f8a-8eab7c9f3912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:32.449514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ca8bd-c56a-4cb7-9f8a-8eab7c9f3912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:32.451250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ca8bd-c56a-4cb7-9f8a-8eab7c9f3912 service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:32.461396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 717/1422] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:33.378914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f297d-e51c-4f4c-a5c3-eed1c8d588eb None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:33.379464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f297d-e51c-4f4c-a5c3-eed1c8d588eb None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:33.379464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f297d-e51c-4f4c-a5c3-eed1c8d588eb None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:33.380966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:33.386067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43c58-bc79-4e13-a734-e32a5a0d7015 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:33.386560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43c58-bc79-4e13-a734-e32a5a0d7015 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:33.386689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43c58-bc79-4e13-a734-e32a5a0d7015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:33.407127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-3fb43c58-bc79-4e13-a734-e32a5a0d7015 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:33.408280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3fb43c58-bc79-4e13-a734-e32a5a0d7015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:33.417057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:33.566766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f297d-e51c-4f4c-a5c3-eed1c8d588eb None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:33.581439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f297d-e51c-4f4c-a5c3-eed1c8d588eb None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:33.587258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2b265-c82c-43be-a76d-bb480fac2431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:33.587926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2b265-c82c-43be-a76d-bb480fac2431 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:33.588206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2b265-c82c-43be-a76d-bb480fac2431 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:33.588507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2b265-c82c-43be-a76d-bb480fac2431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:33.596398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2b265-c82c-43be-a76d-bb480fac2431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:33.597990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2b265-c82c-43be-a76d-bb480fac2431 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:33.607644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 707/1425] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:38:34.579954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fdf15-e324-42d6-9f16-1df2091773d4 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:34.580564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fdf15-e324-42d6-9f16-1df2091773d4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:34.580564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fdf15-e324-42d6-9f16-1df2091773d4 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:34.581941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:34.587492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34488828-c975-4426-815b-0cb4d01b926c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:34.587903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34488828-c975-4426-815b-0cb4d01b926c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:34.588049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34488828-c975-4426-815b-0cb4d01b926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:34.606799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-34488828-c975-4426-815b-0cb4d01b926c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:34.607997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-34488828-c975-4426-815b-0cb4d01b926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:34.616347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:34.767172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fdf15-e324-42d6-9f16-1df2091773d4 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:34.781591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fdf15-e324-42d6-9f16-1df2091773d4 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:34.787632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feca978-a5ac-404d-a18f-2736cb228dfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:34.788273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feca978-a5ac-404d-a18f-2736cb228dfa service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:34.788588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feca978-a5ac-404d-a18f-2736cb228dfa service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:34.788867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feca978-a5ac-404d-a18f-2736cb228dfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:34.797674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feca978-a5ac-404d-a18f-2736cb228dfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:34.799267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feca978-a5ac-404d-a18f-2736cb228dfa service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:34.809176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 720/1428] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:35.745018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89038fb-e89c-4b76-8b93-ce23a49840ab None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:35.745560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89038fb-e89c-4b76-8b93-ce23a49840ab None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:35.745682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89038fb-e89c-4b76-8b93-ce23a49840ab None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:35.747013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:35.751812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3a99a-1dcb-40a9-ae61-4647ea25beb6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:35.752233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3a99a-1dcb-40a9-ae61-4647ea25beb6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:35.752375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3a99a-1dcb-40a9-ae61-4647ea25beb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:35.771812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6ee3a99a-1dcb-40a9-ae61-4647ea25beb6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:35.773045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6ee3a99a-1dcb-40a9-ae61-4647ea25beb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:35.780763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:35.930457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89038fb-e89c-4b76-8b93-ce23a49840ab None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:35.945315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89038fb-e89c-4b76-8b93-ce23a49840ab None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:35.950630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b9f59-7b98-485f-aba0-5e2e571c820d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:35.951265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b9f59-7b98-485f-aba0-5e2e571c820d service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:35.951550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b9f59-7b98-485f-aba0-5e2e571c820d service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:35.951830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b9f59-7b98-485f-aba0-5e2e571c820d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:35.960575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b9f59-7b98-485f-aba0-5e2e571c820d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:35.962154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b9f59-7b98-485f-aba0-5e2e571c820d service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:35.971466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 710/1431] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:36.936018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb3921-6284-4c69-af8a-efae0552f896 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:36.936621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb3921-6284-4c69-af8a-efae0552f896 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:36.936621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb3921-6284-4c69-af8a-efae0552f896 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:36.938009 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:36.943043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2a632-1d74-4fd8-b7ef-6ce9e3708f44 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:36.943442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2a632-1d74-4fd8-b7ef-6ce9e3708f44 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:36.943581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2a632-1d74-4fd8-b7ef-6ce9e3708f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:36.962146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-41f2a632-1d74-4fd8-b7ef-6ce9e3708f44 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:36.963340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-41f2a632-1d74-4fd8-b7ef-6ce9e3708f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:36.971032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:37.119091 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb3921-6284-4c69-af8a-efae0552f896 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:37.133460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb3921-6284-4c69-af8a-efae0552f896 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:37.138809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50b7bb-0bf6-4b0a-a41c-e0c7298ef6bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:37.139442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b7bb-0bf6-4b0a-a41c-e0c7298ef6bb service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:37.139722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b7bb-0bf6-4b0a-a41c-e0c7298ef6bb service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:37.139997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b7bb-0bf6-4b0a-a41c-e0c7298ef6bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:37.148524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50b7bb-0bf6-4b0a-a41c-e0c7298ef6bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:37.150090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50b7bb-0bf6-4b0a-a41c-e0c7298ef6bb service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:37.159474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 723/1434] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:38.067919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87465e06-7c4e-4407-a97b-0da5782894fe None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:38.068498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87465e06-7c4e-4407-a97b-0da5782894fe None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:38.068498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87465e06-7c4e-4407-a97b-0da5782894fe None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:38.069882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:38.074726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928e509-6446-4c8b-b4f3-12a69389e22f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:38.075141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928e509-6446-4c8b-b4f3-12a69389e22f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:38.075286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928e509-6446-4c8b-b4f3-12a69389e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:38.093902 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b928e509-6446-4c8b-b4f3-12a69389e22f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:38.095029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b928e509-6446-4c8b-b4f3-12a69389e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:38.103590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:38.252101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87465e06-7c4e-4407-a97b-0da5782894fe None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:38.269138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87465e06-7c4e-4407-a97b-0da5782894fe None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:38.275229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc1d17-3779-45ca-b7a0-e9356252272a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:38.275866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1d17-3779-45ca-b7a0-e9356252272a service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:38.276152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1d17-3779-45ca-b7a0-e9356252272a service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:38.276469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1d17-3779-45ca-b7a0-e9356252272a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:38.284699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc1d17-3779-45ca-b7a0-e9356252272a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:38.286405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc1d17-3779-45ca-b7a0-e9356252272a service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:38.295792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 713/1437] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:39.256921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca0b4e-edd9-42ed-916b-10d16dbd75f5 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:39.257427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca0b4e-edd9-42ed-916b-10d16dbd75f5 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:39.257555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca0b4e-edd9-42ed-916b-10d16dbd75f5 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:39.258827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:39.263793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a70b0-eb2a-426c-97c5-16de13f2493a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:39.264195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a70b0-eb2a-426c-97c5-16de13f2493a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:39.264391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a70b0-eb2a-426c-97c5-16de13f2493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:39.282955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-693a70b0-eb2a-426c-97c5-16de13f2493a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:39.284159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-693a70b0-eb2a-426c-97c5-16de13f2493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:39.292770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:39.442996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca0b4e-edd9-42ed-916b-10d16dbd75f5 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:39.457030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca0b4e-edd9-42ed-916b-10d16dbd75f5 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:39.463352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf6f07-0367-4cb7-a525-ac44b6aee0d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:39.464000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6f07-0367-4cb7-a525-ac44b6aee0d3 service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:39.464290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6f07-0367-4cb7-a525-ac44b6aee0d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:39.464602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6f07-0367-4cb7-a525-ac44b6aee0d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:39.474187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf6f07-0367-4cb7-a525-ac44b6aee0d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:39.475710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf6f07-0367-4cb7-a525-ac44b6aee0d3 service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:39.485478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 726/1440] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:41.586593 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a717e1-7f8a-408f-9fb2-4dfad7737d30 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:41.587171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a717e1-7f8a-408f-9fb2-4dfad7737d30 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:41.587171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a717e1-7f8a-408f-9fb2-4dfad7737d30 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:41.588552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:41.593965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9c435-8ad2-4054-8d3d-47fb32db016a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:41.594402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9c435-8ad2-4054-8d3d-47fb32db016a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:41.594509 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9c435-8ad2-4054-8d3d-47fb32db016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:41.612943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8de9c435-8ad2-4054-8d3d-47fb32db016a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:41.614298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8de9c435-8ad2-4054-8d3d-47fb32db016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:41.622123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:41.659608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a717e1-7f8a-408f-9fb2-4dfad7737d30 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:41.672258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a717e1-7f8a-408f-9fb2-4dfad7737d30 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:41.676020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9c491-f026-48b5-a6c3-0f12df46375b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:41.677173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9c491-f026-48b5-a6c3-0f12df46375b service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:41.677462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9c491-f026-48b5-a6c3-0f12df46375b service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:41.677741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9c491-f026-48b5-a6c3-0f12df46375b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:41.686757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9c491-f026-48b5-a6c3-0f12df46375b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:41.688321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9c491-f026-48b5-a6c3-0f12df46375b service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:41.700095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 716/1443] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:44.133821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffc875-6744-4bef-b35e-fd7bb69f71b6 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:44.134423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffc875-6744-4bef-b35e-fd7bb69f71b6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:44.134423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffc875-6744-4bef-b35e-fd7bb69f71b6 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:44.135713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:44.141938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d7d91-58eb-40b3-abd4-429c96f0a658 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:44.142394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d7d91-58eb-40b3-abd4-429c96f0a658 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:44.142562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d7d91-58eb-40b3-abd4-429c96f0a658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:44.164276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-957d7d91-58eb-40b3-abd4-429c96f0a658 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:44.165604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-957d7d91-58eb-40b3-abd4-429c96f0a658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:44.174654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:44.215745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffc875-6744-4bef-b35e-fd7bb69f71b6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:44.230330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffc875-6744-4bef-b35e-fd7bb69f71b6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:44.234190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e401e-f01f-4400-b91d-5c38ef56afb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:44.234897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e401e-f01f-4400-b91d-5c38ef56afb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:44.235153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e401e-f01f-4400-b91d-5c38ef56afb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:44.235387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e401e-f01f-4400-b91d-5c38ef56afb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:44.244697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e401e-f01f-4400-b91d-5c38ef56afb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:44.246119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e401e-f01f-4400-b91d-5c38ef56afb4 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:44.256261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 729/1446] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:46.974614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36f8c-af5e-47c7-a01d-6ef276be49f2 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:46.975228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36f8c-af5e-47c7-a01d-6ef276be49f2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:46.975228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36f8c-af5e-47c7-a01d-6ef276be49f2 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:46.976650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:38:46.982094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224e89-a6cc-4915-960f-2ef6da9c2d56 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:46.982547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224e89-a6cc-4915-960f-2ef6da9c2d56 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:46.982650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224e89-a6cc-4915-960f-2ef6da9c2d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:47.000829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-dd224e89-a6cc-4915-960f-2ef6da9c2d56 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:47.002010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-dd224e89-a6cc-4915-960f-2ef6da9c2d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:47.010586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:47.049047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36f8c-af5e-47c7-a01d-6ef276be49f2 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:47.059996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36f8c-af5e-47c7-a01d-6ef276be49f2 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:47.063603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f543-b50a-4e6d-827c-fc219b652b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:47.064237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f543-b50a-4e6d-827c-fc219b652b59 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:47.064553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f543-b50a-4e6d-827c-fc219b652b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:47.064833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f543-b50a-4e6d-827c-fc219b652b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:47.074484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f543-b50a-4e6d-827c-fc219b652b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:47.075915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f543-b50a-4e6d-827c-fc219b652b59 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:47.086044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 719/1449] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:49.507604 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf8285-0bd7-4aef-9732-2e9c085bfd62 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:49.508143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf8285-0bd7-4aef-9732-2e9c085bfd62 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:49.508143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf8285-0bd7-4aef-9732-2e9c085bfd62 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:49.509540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:49.514840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0b6a4-8ada-4b78-9ae5-0f3c26101927 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:49.515288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0b6a4-8ada-4b78-9ae5-0f3c26101927 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:49.515400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0b6a4-8ada-4b78-9ae5-0f3c26101927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:49.533563 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-ada0b6a4-8ada-4b78-9ae5-0f3c26101927 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:49.534756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ada0b6a4-8ada-4b78-9ae5-0f3c26101927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:49.542829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:49.581636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf8285-0bd7-4aef-9732-2e9c085bfd62 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:49.592111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf8285-0bd7-4aef-9732-2e9c085bfd62 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:49.595589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f1e2f-25c4-4be8-8254-1b4fa3cc95d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:49.596223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f1e2f-25c4-4be8-8254-1b4fa3cc95d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:49.596543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f1e2f-25c4-4be8-8254-1b4fa3cc95d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:49.596818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f1e2f-25c4-4be8-8254-1b4fa3cc95d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:49.606204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f1e2f-25c4-4be8-8254-1b4fa3cc95d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:49.607642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f1e2f-25c4-4be8-8254-1b4fa3cc95d1 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:49.617619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 732/1452] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:51.993234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27970b72-445e-4536-a962-8604afc985f7 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:51.993664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27970b72-445e-4536-a962-8604afc985f7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:51.993799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27970b72-445e-4536-a962-8604afc985f7 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:51.995183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:52.000579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27917-7218-490a-b535-ffec06590db3 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:52.000986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27917-7218-490a-b535-ffec06590db3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:52.001162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27917-7218-490a-b535-ffec06590db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:52.018587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-49c27917-7218-490a-b535-ffec06590db3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:52.020446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-49c27917-7218-490a-b535-ffec06590db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:52.028204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:52.067604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27970b72-445e-4536-a962-8604afc985f7 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:52.078235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27970b72-445e-4536-a962-8604afc985f7 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:52.099641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289f55-81f3-41e6-8de8-7a1b6ad0c4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:52.099641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289f55-81f3-41e6-8de8-7a1b6ad0c4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:52.099641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289f55-81f3-41e6-8de8-7a1b6ad0c4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:52.099641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289f55-81f3-41e6-8de8-7a1b6ad0c4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:52.100206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c289f55-81f3-41e6-8de8-7a1b6ad0c4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:52.100206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c289f55-81f3-41e6-8de8-7a1b6ad0c4a8 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:52.104744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 722/1455] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:54.394789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec1f26-27d2-4d3e-8554-421f65c5be95 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:54.395379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec1f26-27d2-4d3e-8554-421f65c5be95 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:54.395379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec1f26-27d2-4d3e-8554-421f65c5be95 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:54.396731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:54.401998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6af39-475f-4f53-b1ec-e2e9d5d01735 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:54.402426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6af39-475f-4f53-b1ec-e2e9d5d01735 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:54.402565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6af39-475f-4f53-b1ec-e2e9d5d01735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:54.420824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-66d6af39-475f-4f53-b1ec-e2e9d5d01735 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:54.422004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-66d6af39-475f-4f53-b1ec-e2e9d5d01735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:54.429906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:54.468890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec1f26-27d2-4d3e-8554-421f65c5be95 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:54.479819 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec1f26-27d2-4d3e-8554-421f65c5be95 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:54.483364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef21f0-9968-4715-8db5-3748679adbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:54.484017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef21f0-9968-4715-8db5-3748679adbdb service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:54.484321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef21f0-9968-4715-8db5-3748679adbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:54.484609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef21f0-9968-4715-8db5-3748679adbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:54.493471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef21f0-9968-4715-8db5-3748679adbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:54.494898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef21f0-9968-4715-8db5-3748679adbdb service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:54.504818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 735/1458] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:56.771701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bff2be-dda2-487d-922c-459bf17efda2 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:56.772328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bff2be-dda2-487d-922c-459bf17efda2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:56.772328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bff2be-dda2-487d-922c-459bf17efda2 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:56.773685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:56.778988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12cfb0-5b4e-48dc-bff1-a49c0d2064d7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:56.779401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12cfb0-5b4e-48dc-bff1-a49c0d2064d7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:56.779541 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12cfb0-5b4e-48dc-bff1-a49c0d2064d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:56.786243 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=70 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:38:56.798013 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-cb12cfb0-5b4e-48dc-bff1-a49c0d2064d7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:56.802169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cb12cfb0-5b4e-48dc-bff1-a49c0d2064d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:56.807745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:56.845225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bff2be-dda2-487d-922c-459bf17efda2 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:56.851692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=73 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:38:56.857573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bff2be-dda2-487d-922c-459bf17efda2 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:56.861066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665044fa-6daa-4e0a-b5c2-d0b26f623227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:56.861688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665044fa-6daa-4e0a-b5c2-d0b26f623227 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:56.861968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665044fa-6daa-4e0a-b5c2-d0b26f623227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:56.862240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665044fa-6daa-4e0a-b5c2-d0b26f623227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:56.871716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665044fa-6daa-4e0a-b5c2-d0b26f623227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:56.873195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665044fa-6daa-4e0a-b5c2-d0b26f623227 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:56.883069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 725/1461] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:38:59.132465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c74e73-b4e7-4f86-94f1-13b25e8f32b7 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:59.133033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c74e73-b4e7-4f86-94f1-13b25e8f32b7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:59.133033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c74e73-b4e7-4f86-94f1-13b25e8f32b7 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:59.134377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:38:59.139589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4545c8-f29d-4e06-80e4-978f3e848d01 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:59.139997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4545c8-f29d-4e06-80e4-978f3e848d01 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:59.140144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4545c8-f29d-4e06-80e4-978f3e848d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:59.158259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2e4545c8-f29d-4e06-80e4-978f3e848d01 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:38:59.159597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2e4545c8-f29d-4e06-80e4-978f3e848d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:38:59.167213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:38:59.204034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c74e73-b4e7-4f86-94f1-13b25e8f32b7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:38:59.215779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c74e73-b4e7-4f86-94f1-13b25e8f32b7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:38:59.219331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e53a43-9a72-43c8-88c4-c829c4ec01ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:38:59.219970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53a43-9a72-43c8-88c4-c829c4ec01ec service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:38:59.220250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53a43-9a72-43c8-88c4-c829c4ec01ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:38:59.220557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53a43-9a72-43c8-88c4-c829c4ec01ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:38:59.229897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e53a43-9a72-43c8-88c4-c829c4ec01ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:38:59.231310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e53a43-9a72-43c8-88c4-c829c4ec01ec service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:38:59.240776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 738/1464] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:39:01.475167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2667834-9346-4727-ae50-e42a1df96777 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:01.475720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2667834-9346-4727-ae50-e42a1df96777 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:01.475720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2667834-9346-4727-ae50-e42a1df96777 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:01.477361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:01.482703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788357c-d73a-49a2-bd9c-d208f7f45492 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:01.483121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788357c-d73a-49a2-bd9c-d208f7f45492 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:01.483339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788357c-d73a-49a2-bd9c-d208f7f45492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:01.500789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1788357c-d73a-49a2-bd9c-d208f7f45492 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:01.501981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1788357c-d73a-49a2-bd9c-d208f7f45492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:01.510548 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:39:01.546589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2667834-9346-4727-ae50-e42a1df96777 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:39:01.557797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2667834-9346-4727-ae50-e42a1df96777 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:39:01.561307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54a92d-179b-4ff6-9107-8c1a51f27204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:39:01.561930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54a92d-179b-4ff6-9107-8c1a51f27204 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:01.562207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54a92d-179b-4ff6-9107-8c1a51f27204 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:01.562475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54a92d-179b-4ff6-9107-8c1a51f27204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:01.571677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54a92d-179b-4ff6-9107-8c1a51f27204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:39:01.573130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54a92d-179b-4ff6-9107-8c1a51f27204 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:39:01.582304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 728/1467] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:39:03.865583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e598ff-919e-4d07-81fd-cf57177cb078 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:03.866126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e598ff-919e-4d07-81fd-cf57177cb078 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:03.866126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e598ff-919e-4d07-81fd-cf57177cb078 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:03.867527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:03.872846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d24710-347f-4468-8e27-6fe7e1955110 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:03.873305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d24710-347f-4468-8e27-6fe7e1955110 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:03.873416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d24710-347f-4468-8e27-6fe7e1955110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:03.892003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-13d24710-347f-4468-8e27-6fe7e1955110 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:03.893270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-13d24710-347f-4468-8e27-6fe7e1955110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:03.901166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:39:03.936927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e598ff-919e-4d07-81fd-cf57177cb078 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:39:03.948668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e598ff-919e-4d07-81fd-cf57177cb078 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:39:03.952499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9ee74-bb74-4f14-a4bc-4db660f35ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:39:03.953137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9ee74-bb74-4f14-a4bc-4db660f35ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:03.953422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9ee74-bb74-4f14-a4bc-4db660f35ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:03.953723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9ee74-bb74-4f14-a4bc-4db660f35ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:03.962680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9ee74-bb74-4f14-a4bc-4db660f35ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:39:03.964109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9ee74-bb74-4f14-a4bc-4db660f35ac4 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:39:03.973773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 741/1470] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:39:13.886376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=17 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:39:13.969284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=17 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:39:37.519763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9f913-4e02-44ac-9b8e-b93e0eed04bf None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:37.520386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9f913-4e02-44ac-9b8e-b93e0eed04bf None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:37.520386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9f913-4e02-44ac-9b8e-b93e0eed04bf None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:37.521744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 730/1471] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:37.527139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e82e9-81cd-4672-913a-47cf1889237a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:37.527574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e82e9-81cd-4672-913a-47cf1889237a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:37.527676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e82e9-81cd-4672-913a-47cf1889237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:37.545622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b93e82e9-81cd-4672-913a-47cf1889237a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:37.546814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b93e82e9-81cd-4672-913a-47cf1889237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:37.555220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 742/1472] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:39:37.602751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac94e25-8852-4512-90d7-355d89a5f7ab None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:37.603039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac94e25-8852-4512-90d7-355d89a5f7ab None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:37.603347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac94e25-8852-4512-90d7-355d89a5f7ab None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:37.604770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 731/1473] 10.222.0.74 () {54 vars in 962 bytes} [Mon May 23 16:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:37.609653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294512c-594b-4282-9890-2a2c7d598d22 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:37.609946 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294512c-594b-4282-9890-2a2c7d598d22 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:37.610231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294512c-594b-4282-9890-2a2c7d598d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:37.627959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a294512c-594b-4282-9890-2a2c7d598d22 None None] MFA Rules not processed for user `e9533e8371e64161a4c54eeab867a17e`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:37.629184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a294512c-594b-4282-9890-2a2c7d598d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:37.635705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 743/1474] 10.222.0.74 () {58 vars in 1059 bytes} [Mon May 23 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:39:37.643674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac94e25-8852-4512-90d7-355d89a5f7ab None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:39:37.654251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac94e25-8852-4512-90d7-355d89a5f7ab None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:39:37.658426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffe589-d4a0-4044-8add-02218c56fa3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9533e8371e64161a4c54eeab867a17e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:39:37.659057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffe589-d4a0-4044-8add-02218c56fa3b service glance] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:37.659339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffe589-d4a0-4044-8add-02218c56fa3b service glance] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:37.659611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffe589-d4a0-4044-8add-02218c56fa3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:37.668464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffe589-d4a0-4044-8add-02218c56fa3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:39:37.669895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffe589-d4a0-4044-8add-02218c56fa3b service glance] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:39:37.679733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 732/1475] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:39:39.980095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8b876-eb60-46f7-97ac-609cbcfabb29 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:39.980664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8b876-eb60-46f7-97ac-609cbcfabb29 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:39.980784 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8b876-eb60-46f7-97ac-609cbcfabb29 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:39.982081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 744/1476] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:39.987484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460eb67-07b9-4ca2-98a7-1092ef905cf7 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:39.987899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460eb67-07b9-4ca2-98a7-1092ef905cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:39.988028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460eb67-07b9-4ca2-98a7-1092ef905cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:40.005569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-3460eb67-07b9-4ca2-98a7-1092ef905cf7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:40.006755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3460eb67-07b9-4ca2-98a7-1092ef905cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:40.014748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 733/1477] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:39:40.039899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8b876-eb60-46f7-97ac-609cbcfabb29 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:39:40.052531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8b876-eb60-46f7-97ac-609cbcfabb29 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:39:40.056959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66159-a8db-4370-b7c6-9cc7e3db9ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:39:40.057601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66159-a8db-4370-b7c6-9cc7e3db9ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:40.057885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66159-a8db-4370-b7c6-9cc7e3db9ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:40.058160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66159-a8db-4370-b7c6-9cc7e3db9ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:40.058889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e66159-a8db-4370-b7c6-9cc7e3db9ecb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:39:40.060699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WARNING py.warnings [None req-d5e66159-a8db-4370-b7c6-9cc7e3db9ecb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:39:40.060699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: warnings.warn(msg) May 23 16:39:40.060699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: May 23 16:39:40.061848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e66159-a8db-4370-b7c6-9cc7e3db9ecb admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:39:40.081390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 745/1478] 10.222.0.74 () {56 vars in 1108 bytes} [Mon May 23 16:39:40 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:39:42.298680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205b7d9-9f3b-4229-96c6-d050f3e600e5 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:42.299210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205b7d9-9f3b-4229-96c6-d050f3e600e5 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:42.299210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205b7d9-9f3b-4229-96c6-d050f3e600e5 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:42.300585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 734/1479] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:42.305744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e94885-36ae-4b36-a7c3-0d34cbbe2b21 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:42.306121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e94885-36ae-4b36-a7c3-0d34cbbe2b21 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:42.306307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e94885-36ae-4b36-a7c3-0d34cbbe2b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:42.325082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-65e94885-36ae-4b36-a7c3-0d34cbbe2b21 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:42.326298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-65e94885-36ae-4b36-a7c3-0d34cbbe2b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:42.334111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 746/1480] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:39:42.377630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205b7d9-9f3b-4229-96c6-d050f3e600e5 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:39:42.391672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205b7d9-9f3b-4229-96c6-d050f3e600e5 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:39:42.397042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b565d-4321-4f6a-9945-b7f098f0d69f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:39:42.397668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b565d-4321-4f6a-9945-b7f098f0d69f service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:42.397947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b565d-4321-4f6a-9945-b7f098f0d69f service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:42.398216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b565d-4321-4f6a-9945-b7f098f0d69f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:42.406269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b565d-4321-4f6a-9945-b7f098f0d69f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:39:42.407887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b565d-4321-4f6a-9945-b7f098f0d69f service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:39:42.417468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 735/1481] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:39:44.801530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac30914-a535-49f7-be38-5c1c6acea782 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:44.802074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac30914-a535-49f7-be38-5c1c6acea782 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:44.802074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac30914-a535-49f7-be38-5c1c6acea782 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:44.803448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 747/1482] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:44.808706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a83b11-6c95-49e2-ac37-03eb2bbf50a1 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:44.809143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a83b11-6c95-49e2-ac37-03eb2bbf50a1 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:44.809340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a83b11-6c95-49e2-ac37-03eb2bbf50a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:44.827383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c9a83b11-6c95-49e2-ac37-03eb2bbf50a1 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:44.828679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c9a83b11-6c95-49e2-ac37-03eb2bbf50a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:44.836601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 736/1483] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:39:44.874021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac30914-a535-49f7-be38-5c1c6acea782 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:39:44.884807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac30914-a535-49f7-be38-5c1c6acea782 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:39:44.888285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d52b6f-e7d4-4d60-80a3-3ed5485fc3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:39:44.888943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d52b6f-e7d4-4d60-80a3-3ed5485fc3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:44.889224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d52b6f-e7d4-4d60-80a3-3ed5485fc3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:44.897381 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d52b6f-e7d4-4d60-80a3-3ed5485fc3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:44.898824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d52b6f-e7d4-4d60-80a3-3ed5485fc3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:39:44.900259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d52b6f-e7d4-4d60-80a3-3ed5485fc3e7 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:39:44.910026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 748/1484] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:39:47.279301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a802da-16e9-4342-b30b-d08c1f9649e7 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:47.279849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a802da-16e9-4342-b30b-d08c1f9649e7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:47.279948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a802da-16e9-4342-b30b-d08c1f9649e7 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:47.282179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 737/1485] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:47.287372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f01b97-4f5e-4282-bb85-b1568c93dbd2 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:47.287815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f01b97-4f5e-4282-bb85-b1568c93dbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:47.287915 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f01b97-4f5e-4282-bb85-b1568c93dbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:47.307064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-69f01b97-4f5e-4282-bb85-b1568c93dbd2 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:47.308249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-69f01b97-4f5e-4282-bb85-b1568c93dbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:47.315999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 749/1486] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:39:47.354536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a802da-16e9-4342-b30b-d08c1f9649e7 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:39:47.365123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a802da-16e9-4342-b30b-d08c1f9649e7 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:39:47.368547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296fa4a-36ae-47b2-b52e-7f907e420f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:39:47.369173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296fa4a-36ae-47b2-b52e-7f907e420f5b service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:47.369451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296fa4a-36ae-47b2-b52e-7f907e420f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:47.369719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296fa4a-36ae-47b2-b52e-7f907e420f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:47.378396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296fa4a-36ae-47b2-b52e-7f907e420f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:39:47.379806 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296fa4a-36ae-47b2-b52e-7f907e420f5b service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:39:47.388929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 738/1487] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:39:49.790035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247aeba-267d-4161-95e3-c2bd62b8bac7 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:49.790601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247aeba-267d-4161-95e3-c2bd62b8bac7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:49.790601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247aeba-267d-4161-95e3-c2bd62b8bac7 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:49.791924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 750/1488] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:49.797521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094a36e-f393-4e0e-b396-98c0368174f7 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:49.797934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094a36e-f393-4e0e-b396-98c0368174f7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:49.798129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094a36e-f393-4e0e-b396-98c0368174f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:49.816688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-f094a36e-f393-4e0e-b396-98c0368174f7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:49.818023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f094a36e-f393-4e0e-b396-98c0368174f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:49.826046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 739/1489] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:39:49.866103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247aeba-267d-4161-95e3-c2bd62b8bac7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:39:49.876534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247aeba-267d-4161-95e3-c2bd62b8bac7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:39:49.879901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8be665-6a5b-4686-a2e2-07a7f04e457c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:39:49.880560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be665-6a5b-4686-a2e2-07a7f04e457c service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:49.880840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be665-6a5b-4686-a2e2-07a7f04e457c service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:49.881111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be665-6a5b-4686-a2e2-07a7f04e457c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:49.889756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8be665-6a5b-4686-a2e2-07a7f04e457c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:39:49.891694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8be665-6a5b-4686-a2e2-07a7f04e457c service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:39:49.900802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 751/1490] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:39:52.638140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef12321-193f-4e92-b6bf-317bbb45f097 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:52.638805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef12321-193f-4e92-b6bf-317bbb45f097 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:52.638805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef12321-193f-4e92-b6bf-317bbb45f097 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:52.640630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 740/1491] 10.222.0.74 () {54 vars in 926 bytes} [Mon May 23 16:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:39:52.645952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779f67-84f9-4cf2-8249-48b0082074d9 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:52.646389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779f67-84f9-4cf2-8249-48b0082074d9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:52.646568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779f67-84f9-4cf2-8249-48b0082074d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:52.665315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-46779f67-84f9-4cf2-8249-48b0082074d9 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:39:52.666504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-46779f67-84f9-4cf2-8249-48b0082074d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:39:52.674226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 752/1492] 10.222.0.74 () {58 vars in 1023 bytes} [Mon May 23 16:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:39:52.712511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef12321-193f-4e92-b6bf-317bbb45f097 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:39:52.723659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef12321-193f-4e92-b6bf-317bbb45f097 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:39:52.727397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdef0d3-4a95-432d-89a1-e67fff4ed0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:39:52.728027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdef0d3-4a95-432d-89a1-e67fff4ed0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:39:52.728330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdef0d3-4a95-432d-89a1-e67fff4ed0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:39:52.728609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdef0d3-4a95-432d-89a1-e67fff4ed0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:39:52.738412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdef0d3-4a95-432d-89a1-e67fff4ed0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:39:52.739849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdef0d3-4a95-432d-89a1-e67fff4ed0b2 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:39:52.749084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 741/1493] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:40:02.660166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=33 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:40:02.745047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=33 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:41:44.363902 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a42a7f-1577-4fb5-ab8e-2d52fe107d7b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:44.364517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a42a7f-1577-4fb5-ab8e-2d52fe107d7b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:44.364517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a42a7f-1577-4fb5-ab8e-2d52fe107d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:44.382996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b0a42a7f-1577-4fb5-ab8e-2d52fe107d7b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:41:44.384344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b0a42a7f-1577-4fb5-ab8e-2d52fe107d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:41:44.391994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 753/1494] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:41:44.401347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675de16-1b1a-4d63-beaa-cec90aeb0a5b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:44.401857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675de16-1b1a-4d63-beaa-cec90aeb0a5b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:44.401980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675de16-1b1a-4d63-beaa-cec90aeb0a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:44.419770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7675de16-1b1a-4d63-beaa-cec90aeb0a5b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:41:44.420971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7675de16-1b1a-4d63-beaa-cec90aeb0a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:41:44.428543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 742/1495] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:41:44.433630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a42a7f-1577-4fb5-ab8e-2d52fe107d7b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:44.443076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a42a7f-1577-4fb5-ab8e-2d52fe107d7b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:44.447831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:44.448506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:44.448788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:44.449060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:44.449775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:41:44.450074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:44.451176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WARNING py.warnings [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:41:44.451176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: warnings.warn(msg) May 23 16:41:44.451176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: May 23 16:41:44.452068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:44.463492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 754/1496] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:41:44.471653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675de16-1b1a-4d63-beaa-cec90aeb0a5b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:44.481215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675de16-1b1a-4d63-beaa-cec90aeb0a5b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:44.485617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601ea0d-ef16-4b6b-9f26-d1104e894209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:44.486261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601ea0d-ef16-4b6b-9f26-d1104e894209 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:44.486541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601ea0d-ef16-4b6b-9f26-d1104e894209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:44.486813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601ea0d-ef16-4b6b-9f26-d1104e894209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:44.487487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601ea0d-ef16-4b6b-9f26-d1104e894209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:44.489360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WARNING py.warnings [None req-d601ea0d-ef16-4b6b-9f26-d1104e894209 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:41:44.489360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: warnings.warn(msg) May 23 16:41:44.489360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: May 23 16:41:44.490547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601ea0d-ef16-4b6b-9f26-d1104e894209 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:44.625257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 743/1497] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:41:44 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:41:44.629576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:44.639521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97453bb5-cc30-4d39-8310-0d28630ea8a4 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:44.696677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef7552-a8ee-4cb6-9672-fe6cd369ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:44.697338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef7552-a8ee-4cb6-9672-fe6cd369ff4c admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:44.697616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef7552-a8ee-4cb6-9672-fe6cd369ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:44.697889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef7552-a8ee-4cb6-9672-fe6cd369ff4c admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:44.698604 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef7552-a8ee-4cb6-9672-fe6cd369ff4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:44.699610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WARNING py.warnings [None req-5aef7552-a8ee-4cb6-9672-fe6cd369ff4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:41:44.699610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: warnings.warn(msg) May 23 16:41:44.699610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: May 23 16:41:44.700831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef7552-a8ee-4cb6-9672-fe6cd369ff4c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:44.852088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 755/1498] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:41:44 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:41:44.856786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601ea0d-ef16-4b6b-9f26-d1104e894209 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:44.866791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601ea0d-ef16-4b6b-9f26-d1104e894209 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:44.871515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd7d5b-6a68-4de4-9e81-6ce71837d759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:44.872172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd7d5b-6a68-4de4-9e81-6ce71837d759 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:44.872495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd7d5b-6a68-4de4-9e81-6ce71837d759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:44.872774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd7d5b-6a68-4de4-9e81-6ce71837d759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:44.873552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd7d5b-6a68-4de4-9e81-6ce71837d759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:44.874624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WARNING py.warnings [None req-58bd7d5b-6a68-4de4-9e81-6ce71837d759 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:41:44.874624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: warnings.warn(msg) May 23 16:41:44.874624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: May 23 16:41:44.875622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd7d5b-6a68-4de4-9e81-6ce71837d759 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:44.888665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 744/1499] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:41:44.892629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef7552-a8ee-4cb6-9672-fe6cd369ff4c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:44.903843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef7552-a8ee-4cb6-9672-fe6cd369ff4c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:44.908372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8d220-5a86-428d-8507-c4d8ccc1dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:44.909036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8d220-5a86-428d-8507-c4d8ccc1dbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:44.909323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8d220-5a86-428d-8507-c4d8ccc1dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:44.909602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8d220-5a86-428d-8507-c4d8ccc1dbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:44.910330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8d220-5a86-428d-8507-c4d8ccc1dbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:44.911347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WARNING py.warnings [None req-d5b8d220-5a86-428d-8507-c4d8ccc1dbf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:41:44.911347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: warnings.warn(msg) May 23 16:41:44.911347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: May 23 16:41:44.912267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8d220-5a86-428d-8507-c4d8ccc1dbf8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:44.928139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 756/1500] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:41:44.936836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd7d5b-6a68-4de4-9e81-6ce71837d759 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:44.943849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd7d5b-6a68-4de4-9e81-6ce71837d759 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:44.948622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b71e0-3e53-49b0-9716-be5168826ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:44.949498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b71e0-3e53-49b0-9716-be5168826ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:44.949774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b71e0-3e53-49b0-9716-be5168826ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:44.950043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b71e0-3e53-49b0-9716-be5168826ce4 admin admin] PATH_INFO: `/v3/projects/4beb21fee30845e986d71bb73e6455e0/users/3f85586edde7488c88b40825b1df9de6/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:44.973755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b71e0-3e53-49b0-9716-be5168826ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4beb21fee30845e986d71bb73e6455e0, user_id=3f85586edde7488c88b40825b1df9de6, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:44.979201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WARNING py.warnings [None req-719b71e0-3e53-49b0-9716-be5168826ce4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:41:44.979201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: warnings.warn(msg) May 23 16:41:44.979201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: May 23 16:41:44.981168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b71e0-3e53-49b0-9716-be5168826ce4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:45.304407 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 745/1501] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:41:44 2022] PUT /identity/v3/projects/4beb21fee30845e986d71bb73e6455e0/users/3f85586edde7488c88b40825b1df9de6/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:41:45.316493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c888a-e758-45be-b2f3-0d2f31cc17c2 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:45.316800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c888a-e758-45be-b2f3-0d2f31cc17c2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:45.317079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c888a-e758-45be-b2f3-0d2f31cc17c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:45.345804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-e19c888a-e758-45be-b2f3-0d2f31cc17c2 None None] MFA Rules not processed for user `3f85586edde7488c88b40825b1df9de6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:41:45.347034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e19c888a-e758-45be-b2f3-0d2f31cc17c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:41:45.410341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 757/1502] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:41:45.423791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40cdd-c2ac-484b-b535-0fbaf9248a29 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:45.424231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40cdd-c2ac-484b-b535-0fbaf9248a29 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:45.424391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40cdd-c2ac-484b-b535-0fbaf9248a29 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:45.426452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 746/1503] 10.222.0.74 () {54 vars in 963 bytes} [Mon May 23 16:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:41:45.431709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46c051-6622-4653-99e0-905a354452a0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:45.432015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46c051-6622-4653-99e0-905a354452a0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:45.432282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46c051-6622-4653-99e0-905a354452a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:45.451985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1b46c051-6622-4653-99e0-905a354452a0 None None] MFA Rules not processed for user `6d377792af1c4ad19519e2e98bac72e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:41:45.453268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1b46c051-6622-4653-99e0-905a354452a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:41:45.501162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:41:45.508667 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 758/1504] 10.222.0.74 () {58 vars in 1060 bytes} [Mon May 23 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:41:45.623240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40cdd-c2ac-484b-b535-0fbaf9248a29 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:45.635115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40cdd-c2ac-484b-b535-0fbaf9248a29 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:45.638742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb60cb-d23e-44a0-8ae4-59d91a5b241c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:45.643592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb60cb-d23e-44a0-8ae4-59d91a5b241c service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:45.643592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb60cb-d23e-44a0-8ae4-59d91a5b241c service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:45.643592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb60cb-d23e-44a0-8ae4-59d91a5b241c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:45.649412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb60cb-d23e-44a0-8ae4-59d91a5b241c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:45.650999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb60cb-d23e-44a0-8ae4-59d91a5b241c service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:45.660833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 747/1505] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:41:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:41:45.704417 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33d47d-9fe4-4492-a96b-c793d010a162 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:45.704704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33d47d-9fe4-4492-a96b-c793d010a162 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:45.704980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33d47d-9fe4-4492-a96b-c793d010a162 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:45.706270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 759/1506] 10.222.0.74 () {52 vars in 829 bytes} [Mon May 23 16:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:41:45.710100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb60cb-d23e-44a0-8ae4-59d91a5b241c service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:45.778833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb60cb-d23e-44a0-8ae4-59d91a5b241c service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:45.783372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:45.784243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:45.784558 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:45.784831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] PATH_INFO: `/v3/users/3f85586edde7488c88b40825b1df9de6` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:45.786021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f85586edde7488c88b40825b1df9de6)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:45.787033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WARNING py.warnings [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:41:45.787033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: warnings.warn(msg) May 23 16:41:45.787033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: May 23 16:41:45.788249 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:46.028024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f85586edde7488c88b40825b1df9de6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:46.109167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f85586edde7488c88b40825b1df9de6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:46.109793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f85586edde7488c88b40825b1df9de6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:46.110505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f85586edde7488c88b40825b1df9de6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:46.125053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f85586edde7488c88b40825b1df9de6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:46.144107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:41:46.157030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 748/1507] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:41:45 2022] DELETE /identity/v3/users/3f85586edde7488c88b40825b1df9de6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:41:46.161526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c7820-81fa-491e-babf-d1bf07be7627 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:46.161822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c7820-81fa-491e-babf-d1bf07be7627 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:46.162107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c7820-81fa-491e-babf-d1bf07be7627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:46.181388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-f20c7820-81fa-491e-babf-d1bf07be7627 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:41:46.187777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f20c7820-81fa-491e-babf-d1bf07be7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:41:46.243187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 760/1508] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:41:46.252677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:46.254130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:41:46.441360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69315acd-df4d-4006-9603-59c3e0caa7cd admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:46.444855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d324c6-352f-4293-97e4-cd530c4bc161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:46.445501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d324c6-352f-4293-97e4-cd530c4bc161 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:46.445785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d324c6-352f-4293-97e4-cd530c4bc161 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:46.446059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d324c6-352f-4293-97e4-cd530c4bc161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:46.455174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d324c6-352f-4293-97e4-cd530c4bc161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:46.456651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d324c6-352f-4293-97e4-cd530c4bc161 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:46.466570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 749/1509] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:41:46.927250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c7820-81fa-491e-babf-d1bf07be7627 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:41:46.928742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f20c7820-81fa-491e-babf-d1bf07be7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:41:46.941495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c7820-81fa-491e-babf-d1bf07be7627 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:41:46.946373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:41:46.950566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:41:46.950899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:41:46.951185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] PATH_INFO: `/v3/projects/4beb21fee30845e986d71bb73e6455e0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:41:46.952494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4beb21fee30845e986d71bb73e6455e0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:41:46.953535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WARNING py.warnings [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:41:46.953535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: warnings.warn(msg) May 23 16:41:46.953535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: May 23 16:41:46.954759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:41:47.064457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4beb21fee30845e986d71bb73e6455e0', 'request_id': 'req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:47.120456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4beb21fee30845e986d71bb73e6455e0', 'request_id': 'req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:47.133943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4beb21fee30845e986d71bb73e6455e0', 'request_id': 'req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:47.145317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] The token cache is being invalidate because project 4beb21fee30845e986d71bb73e6455e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:41:47.145600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:47.146318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fdbadaf9-3c32-4ae9-bc95-88f1c623e52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:41:47.147853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 761/1510] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:41:46 2022] DELETE /identity/v3/projects/4beb21fee30845e986d71bb73e6455e0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:41:56.462399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:41:57.142328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:43:25.104848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee73855-5cca-4935-a054-fd0419d2b9eb None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:25.105422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee73855-5cca-4935-a054-fd0419d2b9eb None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:25.105422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee73855-5cca-4935-a054-fd0419d2b9eb None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:25.106843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:43:25.112342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178577a7-c12d-4e33-b9fb-08c609769f1d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:25.113349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178577a7-c12d-4e33-b9fb-08c609769f1d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:25.113473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178577a7-c12d-4e33-b9fb-08c609769f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:25.132613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-178577a7-c12d-4e33-b9fb-08c609769f1d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:25.133839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-178577a7-c12d-4e33-b9fb-08c609769f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:25.197705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:25.369272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee73855-5cca-4935-a054-fd0419d2b9eb None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:43:25.370959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9ee73855-5cca-4935-a054-fd0419d2b9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:25.445289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee73855-5cca-4935-a054-fd0419d2b9eb None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:43:25.450671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fc500-7f91-4ae6-8615-822c5e396bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:43:25.451308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc500-7f91-4ae6-8615-822c5e396bdb service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:25.451593 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc500-7f91-4ae6-8615-822c5e396bdb service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:25.451870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc500-7f91-4ae6-8615-822c5e396bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:25.459979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fc500-7f91-4ae6-8615-822c5e396bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:43:25.461605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fc500-7f91-4ae6-8615-822c5e396bdb service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:43:25.471117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 751/1513] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:43:26.293879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683b91-3669-4bf7-a87a-3c7bd20f85b2 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:26.294443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683b91-3669-4bf7-a87a-3c7bd20f85b2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:26.294443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683b91-3669-4bf7-a87a-3c7bd20f85b2 None None] PATH_INFO: `/v3` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:26.295745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 763/1514] 10.222.0.71 () {54 vars in 925 bytes} [Mon May 23 16:43:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:43:26.302296 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015ae32-e5d3-470a-a581-09e73253206b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:26.302789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015ae32-e5d3-470a-a581-09e73253206b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:26.302895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015ae32-e5d3-470a-a581-09e73253206b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:26.321103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d015ae32-e5d3-470a-a581-09e73253206b None None] MFA Rules not processed for user `a5997b3965f44d6fbdf55cccdfc52ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:26.322358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d015ae32-e5d3-470a-a581-09e73253206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:26.387877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 752/1515] 10.222.0.71 () {58 vars in 1015 bytes} [Mon May 23 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:26.402142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e40e-b50b-4f45-898e-5d05aa9384fb None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:26.402439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e40e-b50b-4f45-898e-5d05aa9384fb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:26.402790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e40e-b50b-4f45-898e-5d05aa9384fb None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:26.404182 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 764/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:43:26.409192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68cd7d-93b1-4fc1-a60b-8efa71c39dc9 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:26.409525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68cd7d-93b1-4fc1-a60b-8efa71c39dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:26.409795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68cd7d-93b1-4fc1-a60b-8efa71c39dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:26.428342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8f68cd7d-93b1-4fc1-a60b-8efa71c39dc9 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:26.429555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8f68cd7d-93b1-4fc1-a60b-8efa71c39dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:26.437319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 753/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:26.590774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e40e-b50b-4f45-898e-5d05aa9384fb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:43:26.605138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e40e-b50b-4f45-898e-5d05aa9384fb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:43:26.611080 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bc5bf-9f84-4528-8f91-13bd5a4d7f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:43:26.611713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bc5bf-9f84-4528-8f91-13bd5a4d7f0e service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:26.611989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bc5bf-9f84-4528-8f91-13bd5a4d7f0e service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:26.612261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bc5bf-9f84-4528-8f91-13bd5a4d7f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:26.620845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8bc5bf-9f84-4528-8f91-13bd5a4d7f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:43:26.622762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8bc5bf-9f84-4528-8f91-13bd5a4d7f0e service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:43:26.632422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 765/1518] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:43:30.630910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee348b7-e27c-41ae-b8c7-3b844a2e6097 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:30.631503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee348b7-e27c-41ae-b8c7-3b844a2e6097 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:30.631503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee348b7-e27c-41ae-b8c7-3b844a2e6097 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:30.633418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 754/1519] 10.222.0.74 () {54 vars in 960 bytes} [Mon May 23 16:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:43:30.638472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e5f4-9ce6-4abd-b2fc-5a50bc13e5dc None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:30.638884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e5f4-9ce6-4abd-b2fc-5a50bc13e5dc None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:30.639030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e5f4-9ce6-4abd-b2fc-5a50bc13e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:30.657686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6481e5f4-9ce6-4abd-b2fc-5a50bc13e5dc None None] MFA Rules not processed for user `a5997b3965f44d6fbdf55cccdfc52ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:30.658894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6481e5f4-9ce6-4abd-b2fc-5a50bc13e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:30.674632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 766/1520] 10.222.0.74 () {58 vars in 1057 bytes} [Mon May 23 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:30.675561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee348b7-e27c-41ae-b8c7-3b844a2e6097 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:43:30.688769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee348b7-e27c-41ae-b8c7-3b844a2e6097 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:43:30.693624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9f03a-20b6-4658-a1e0-e284f4b2b644 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:43:30.694277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9f03a-20b6-4658-a1e0-e284f4b2b644 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:30.695209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9f03a-20b6-4658-a1e0-e284f4b2b644 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:30.695535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9f03a-20b6-4658-a1e0-e284f4b2b644 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:30.703688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9f03a-20b6-4658-a1e0-e284f4b2b644 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:43:30.705320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9f03a-20b6-4658-a1e0-e284f4b2b644 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:43:30.715801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 755/1521] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:43:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:43:37.931500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c47d1-e7e2-4320-bad1-4d790c9fa88e None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:37.932865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c47d1-e7e2-4320-bad1-4d790c9fa88e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:37.932865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c47d1-e7e2-4320-bad1-4d790c9fa88e None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:37.934078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:43:37.938771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ba485-3bae-4736-a3b8-3ff9c06d8e9a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:37.939219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ba485-3bae-4736-a3b8-3ff9c06d8e9a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:37.939331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ba485-3bae-4736-a3b8-3ff9c06d8e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:37.957506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c89ba485-3bae-4736-a3b8-3ff9c06d8e9a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:37.958711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c89ba485-3bae-4736-a3b8-3ff9c06d8e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:37.966779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:38.119107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c47d1-e7e2-4320-bad1-4d790c9fa88e None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:43:38.134492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c47d1-e7e2-4320-bad1-4d790c9fa88e None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:43:38.139888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7510d-bacb-4439-8180-ad8f50b2748b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:43:38.140603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7510d-bacb-4439-8180-ad8f50b2748b service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:38.140891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7510d-bacb-4439-8180-ad8f50b2748b service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:38.141170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7510d-bacb-4439-8180-ad8f50b2748b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:38.149465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7510d-bacb-4439-8180-ad8f50b2748b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:43:38.151833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7510d-bacb-4439-8180-ad8f50b2748b service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:43:38.161311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 768/1524] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:43:39.038148 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f92a0-e4da-49eb-90da-a88f9832ad08 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:39.038711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f92a0-e4da-49eb-90da-a88f9832ad08 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:39.038711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f92a0-e4da-49eb-90da-a88f9832ad08 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:39.040107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 16:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:43:39.045590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa414df-8291-4f18-9b0e-7a009ab06a19 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:39.046043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa414df-8291-4f18-9b0e-7a009ab06a19 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:39.046156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa414df-8291-4f18-9b0e-7a009ab06a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:39.063951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8aa414df-8291-4f18-9b0e-7a009ab06a19 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:39.065207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8aa414df-8291-4f18-9b0e-7a009ab06a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:39.073072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:39.224721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f92a0-e4da-49eb-90da-a88f9832ad08 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:43:39.239722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f92a0-e4da-49eb-90da-a88f9832ad08 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:43:39.245165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd245e-d2a6-47ee-9fcd-03845858f771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:43:39.245804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd245e-d2a6-47ee-9fcd-03845858f771 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:39.246084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd245e-d2a6-47ee-9fcd-03845858f771 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:39.246361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd245e-d2a6-47ee-9fcd-03845858f771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:39.254458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd245e-d2a6-47ee-9fcd-03845858f771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:43:39.256083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd245e-d2a6-47ee-9fcd-03845858f771 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:43:39.265918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 758/1527] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:43:43.352259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf262d-f4f7-4346-8e40-d0607d613eaa None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:43.352853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf262d-f4f7-4346-8e40-d0607d613eaa None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:43.352853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf262d-f4f7-4346-8e40-d0607d613eaa None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:43.354212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:43:43.360411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698621b-8bd2-4efe-ac6c-3a1bfe1abf9c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:43.360862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698621b-8bd2-4efe-ac6c-3a1bfe1abf9c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:43.360955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698621b-8bd2-4efe-ac6c-3a1bfe1abf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:43.380494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8698621b-8bd2-4efe-ac6c-3a1bfe1abf9c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:43.381731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8698621b-8bd2-4efe-ac6c-3a1bfe1abf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:43.400110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:43.436792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf262d-f4f7-4346-8e40-d0607d613eaa None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:43:43.438515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3cbf262d-f4f7-4346-8e40-d0607d613eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:43.497925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf262d-f4f7-4346-8e40-d0607d613eaa None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:43:43.501385 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279809a5-5c89-4086-9980-187d89176e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:43:43.502032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279809a5-5c89-4086-9980-187d89176e8b service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:43.502312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279809a5-5c89-4086-9980-187d89176e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:43.502585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279809a5-5c89-4086-9980-187d89176e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:43.511445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279809a5-5c89-4086-9980-187d89176e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:43:43.512912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279809a5-5c89-4086-9980-187d89176e8b service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:43:43.522439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 771/1530] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:43:45.708108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03f82a-577e-4702-8c9f-c9999815d57d None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:45.708690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03f82a-577e-4702-8c9f-c9999815d57d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:45.708690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03f82a-577e-4702-8c9f-c9999815d57d None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:45.710120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:43:45.716269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e3341-0f47-47bb-bb41-76fb367daa71 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:45.716731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e3341-0f47-47bb-bb41-76fb367daa71 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:45.716836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e3341-0f47-47bb-bb41-76fb367daa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:45.735490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b04e3341-0f47-47bb-bb41-76fb367daa71 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:45.736712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b04e3341-0f47-47bb-bb41-76fb367daa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:45.744496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:45.780677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03f82a-577e-4702-8c9f-c9999815d57d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:43:45.782356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3c03f82a-577e-4702-8c9f-c9999815d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:45.795933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03f82a-577e-4702-8c9f-c9999815d57d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:43:45.799458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebad97-61b3-4d3e-a032-004168e1c758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:43:45.800120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebad97-61b3-4d3e-a032-004168e1c758 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:45.800510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebad97-61b3-4d3e-a032-004168e1c758 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:45.800790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebad97-61b3-4d3e-a032-004168e1c758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:45.809800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebad97-61b3-4d3e-a032-004168e1c758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:43:45.811222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebad97-61b3-4d3e-a032-004168e1c758 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:43:45.820482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 761/1533] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:43:49.634659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af7fc-d2ef-4972-b14d-e615e52bd1e4 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:49.635232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af7fc-d2ef-4972-b14d-e615e52bd1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:49.635456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af7fc-d2ef-4972-b14d-e615e52bd1e4 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:49.637047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:43:49.642362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e21e80-cc9b-46e8-9db5-539d54fb5d1b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:49.642767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e21e80-cc9b-46e8-9db5-539d54fb5d1b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:49.642925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e21e80-cc9b-46e8-9db5-539d54fb5d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:49.649234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=91 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:43:49.664646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-97e21e80-cc9b-46e8-9db5-539d54fb5d1b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:49.665853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-97e21e80-cc9b-46e8-9db5-539d54fb5d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:49.674329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:49.945191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af7fc-d2ef-4972-b14d-e615e52bd1e4 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:43:49.946872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b97af7fc-d2ef-4972-b14d-e615e52bd1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:49.953191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=75 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:43:50.004890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af7fc-d2ef-4972-b14d-e615e52bd1e4 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:43:50.008369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba13635-4ffc-40e5-b4a6-1285dfeaeb4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:43:50.009010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba13635-4ffc-40e5-b4a6-1285dfeaeb4b service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:50.009290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba13635-4ffc-40e5-b4a6-1285dfeaeb4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:50.009560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba13635-4ffc-40e5-b4a6-1285dfeaeb4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:50.019060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba13635-4ffc-40e5-b4a6-1285dfeaeb4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:43:50.020507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba13635-4ffc-40e5-b4a6-1285dfeaeb4b service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:43:50.031054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 774/1536] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:43:52.295257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356279-edc7-4bc2-bbda-8fd8fd80ef67 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:52.295800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356279-edc7-4bc2-bbda-8fd8fd80ef67 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:52.295899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356279-edc7-4bc2-bbda-8fd8fd80ef67 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:52.297278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 16:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:43:52.302438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa303-52c6-4f8b-97e6-deef112c5518 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:52.302860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa303-52c6-4f8b-97e6-deef112c5518 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:52.303002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa303-52c6-4f8b-97e6-deef112c5518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:52.320784 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d7caa303-52c6-4f8b-97e6-deef112c5518 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:43:52.322017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d7caa303-52c6-4f8b-97e6-deef112c5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:52.330832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 16:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:43:52.600743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4356279-edc7-4bc2-bbda-8fd8fd80ef67 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:43:52.602443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a4356279-edc7-4bc2-bbda-8fd8fd80ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:43:52.616074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4356279-edc7-4bc2-bbda-8fd8fd80ef67 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:43:52.619655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a9b58-e857-4203-bcec-19a2380ddd9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:43:52.620334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a9b58-e857-4203-bcec-19a2380ddd9e service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:43:52.620633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a9b58-e857-4203-bcec-19a2380ddd9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:43:52.620902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a9b58-e857-4203-bcec-19a2380ddd9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:43:52.630054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a9b58-e857-4203-bcec-19a2380ddd9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:43:52.631475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a9b58-e857-4203-bcec-19a2380ddd9e service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:43:52.640775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 764/1539] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:44:02.315791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=28 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:44:02.636650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=8 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:23.503708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a260de9-8fe6-4f68-b47b-792577b8ca2d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.504356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a260de9-8fe6-4f68-b47b-792577b8ca2d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.504356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a260de9-8fe6-4f68-b47b-792577b8ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.540191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9a260de9-8fe6-4f68-b47b-792577b8ca2d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.541429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9a260de9-8fe6-4f68-b47b-792577b8ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.551927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 776/1540] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:45:23.556519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e41b78-86cd-4202-b2f9-026cc3a599b2 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.557692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e41b78-86cd-4202-b2f9-026cc3a599b2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.558453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e41b78-86cd-4202-b2f9-026cc3a599b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.566658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105e492-a950-46f6-a9c2-c7f07afc300c None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.566987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105e492-a950-46f6-a9c2-c7f07afc300c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.567212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105e492-a950-46f6-a9c2-c7f07afc300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.590969 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-49e41b78-86cd-4202-b2f9-026cc3a599b2 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.592416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-49e41b78-86cd-4202-b2f9-026cc3a599b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.612461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6105e492-a950-46f6-a9c2-c7f07afc300c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.614373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6105e492-a950-46f6-a9c2-c7f07afc300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.617143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 765/1541] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:23.627791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b8a4-7b82-4f7b-833c-380937e61ef7 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.628107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b8a4-7b82-4f7b-833c-380937e61ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.629154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b8a4-7b82-4f7b-833c-380937e61ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.658256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 777/1542] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:45:23.661437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-4d97b8a4-7b82-4f7b-833c-380937e61ef7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.661578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a4cb6-153a-4e81-9d7e-4ed63a0c6e92 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.661578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a4cb6-153a-4e81-9d7e-4ed63a0c6e92 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.661578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a4cb6-153a-4e81-9d7e-4ed63a0c6e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.661808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4d97b8a4-7b82-4f7b-833c-380937e61ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.677219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 766/1543] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:23.678103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97b8a4-7b82-4f7b-833c-380937e61ef7 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:23.692683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97b8a4-7b82-4f7b-833c-380937e61ef7 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:23.704440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:23.705128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.705419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.705949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.706742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:23.707052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:23.708208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WARNING py.warnings [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:45:23.708208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: warnings.warn(msg) May 23 16:45:23.708208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: May 23 16:45:23.709135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:23.711231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d71a4cb6-153a-4e81-9d7e-4ed63a0c6e92 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.712770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d71a4cb6-153a-4e81-9d7e-4ed63a0c6e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.722116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 778/1544] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:23.723455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e17e7-d855-40ea-9ef0-0f40946c93f4 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.723748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e17e7-d855-40ea-9ef0-0f40946c93f4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.724189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e17e7-d855-40ea-9ef0-0f40946c93f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.729508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 767/1545] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:23.731656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:23.744050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e5697-51d6-40e8-a5d1-9981d567f040 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:23.751230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85a723-f0bd-48b0-b0fe-3183342df575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:23.751917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a723-f0bd-48b0-b0fe-3183342df575 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.752206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a723-f0bd-48b0-b0fe-3183342df575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.752516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a723-f0bd-48b0-b0fe-3183342df575 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.753256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85a723-f0bd-48b0-b0fe-3183342df575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:23.753564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85a723-f0bd-48b0-b0fe-3183342df575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:23.755187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-5a6e17e7-d855-40ea-9ef0-0f40946c93f4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.755973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85a723-f0bd-48b0-b0fe-3183342df575 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:23.756399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5a6e17e7-d855-40ea-9ef0-0f40946c93f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.767022 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 779/1546] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:23.768829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9663bb-0128-41f1-8800-3fdd4a17d42d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.769126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9663bb-0128-41f1-8800-3fdd4a17d42d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.769413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9663bb-0128-41f1-8800-3fdd4a17d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.775785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 768/1547] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:23.777171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a206d67-fae5-4f78-98d4-a52205700e29 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.777465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a206d67-fae5-4f78-98d4-a52205700e29 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.777751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a206d67-fae5-4f78-98d4-a52205700e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.798741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-4a206d67-fae5-4f78-98d4-a52205700e29 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.799704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-de9663bb-0128-41f1-8800-3fdd4a17d42d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.799975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4a206d67-fae5-4f78-98d4-a52205700e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.800888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-de9663bb-0128-41f1-8800-3fdd4a17d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.809439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 769/1548] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:23.810818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaeed-1421-4ab4-bc53-dc86b5079a3e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.811000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 780/1549] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:23.811175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaeed-1421-4ab4-bc53-dc86b5079a3e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.811391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaeed-1421-4ab4-bc53-dc86b5079a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.811689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9663bb-0128-41f1-8800-3fdd4a17d42d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:23.829565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9663bb-0128-41f1-8800-3fdd4a17d42d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:23.834921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646be92-67dd-4d28-977a-3d988851555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:23.835583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646be92-67dd-4d28-977a-3d988851555f admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.835860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646be92-67dd-4d28-977a-3d988851555f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.836130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646be92-67dd-4d28-977a-3d988851555f admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.836963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646be92-67dd-4d28-977a-3d988851555f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:23.837725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a5cbaeed-1421-4ab4-bc53-dc86b5079a3e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.838096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WARNING py.warnings [None req-7646be92-67dd-4d28-977a-3d988851555f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:45:23.838096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: warnings.warn(msg) May 23 16:45:23.838096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: May 23 16:45:23.839312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646be92-67dd-4d28-977a-3d988851555f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:23.839441 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a5cbaeed-1421-4ab4-bc53-dc86b5079a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.848103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 770/1550] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:23.849446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f5982-3d8f-4d38-be12-86212a2f4c73 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.849868 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f5982-3d8f-4d38-be12-86212a2f4c73 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.850242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f5982-3d8f-4d38-be12-86212a2f4c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.877392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2a5f5982-3d8f-4d38-be12-86212a2f4c73 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.878592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2a5f5982-3d8f-4d38-be12-86212a2f4c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:23.886364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 771/1551] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:23.887246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f5982-3d8f-4d38-be12-86212a2f4c73 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:23.896176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f5982-3d8f-4d38-be12-86212a2f4c73 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:23.900667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669270d-bd06-4764-bb47-bea382c5500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:23.901288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669270d-bd06-4764-bb47-bea382c5500f admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.901572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669270d-bd06-4764-bb47-bea382c5500f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.901847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669270d-bd06-4764-bb47-bea382c5500f admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.902603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669270d-bd06-4764-bb47-bea382c5500f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:23.904537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669270d-bd06-4764-bb47-bea382c5500f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:23.947603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 781/1552] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:23.949043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51371f4c-33d2-48f5-ba67-7ee563a7f589 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:23.949331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51371f4c-33d2-48f5-ba67-7ee563a7f589 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:23.949618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51371f4c-33d2-48f5-ba67-7ee563a7f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:23.967030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-51371f4c-33d2-48f5-ba67-7ee563a7f589 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:23.968256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-51371f4c-33d2-48f5-ba67-7ee563a7f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:24.025715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 782/1553] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:24.027703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d33233-6482-4ac6-9504-3ab265021249 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.027998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d33233-6482-4ac6-9504-3ab265021249 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.028283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d33233-6482-4ac6-9504-3ab265021249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.048987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 772/1554] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:23 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:24.049189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-54d33233-6482-4ac6-9504-3ab265021249 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:24.049318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e6096-fa63-40be-ad29-443405ef48b7 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.049318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e6096-fa63-40be-ad29-443405ef48b7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.049318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e6096-fa63-40be-ad29-443405ef48b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.049587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-54d33233-6482-4ac6-9504-3ab265021249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:24.066726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6f9e6096-fa63-40be-ad29-443405ef48b7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:24.068043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6f9e6096-fa63-40be-ad29-443405ef48b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:24.111168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 783/1555] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:24.112290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d33233-6482-4ac6-9504-3ab265021249 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.122340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d33233-6482-4ac6-9504-3ab265021249 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.126867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5f070-2949-43af-a5ac-9ef9ff9506e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.127511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5f070-2949-43af-a5ac-9ef9ff9506e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.127793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5f070-2949-43af-a5ac-9ef9ff9506e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.128073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5f070-2949-43af-a5ac-9ef9ff9506e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.128834 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5f070-2949-43af-a5ac-9ef9ff9506e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:24.129144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5f070-2949-43af-a5ac-9ef9ff9506e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.129484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 773/1556] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:24.130742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5f070-2949-43af-a5ac-9ef9ff9506e1 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.130860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145255c8-f46d-431f-96b3-f7b810ddcafc None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.131040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145255c8-f46d-431f-96b3-f7b810ddcafc None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.131315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145255c8-f46d-431f-96b3-f7b810ddcafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.148054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 784/1557] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:24.148054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5f070-2949-43af-a5ac-9ef9ff9506e1 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.153570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5f070-2949-43af-a5ac-9ef9ff9506e1 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.155420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-145255c8-f46d-431f-96b3-f7b810ddcafc None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:24.156669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-145255c8-f46d-431f-96b3-f7b810ddcafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:24.158155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc99bfc-0612-4ad2-9b55-0ebd95228592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.158802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc99bfc-0612-4ad2-9b55-0ebd95228592 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.159084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc99bfc-0612-4ad2-9b55-0ebd95228592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.159360 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc99bfc-0612-4ad2-9b55-0ebd95228592 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.160074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc99bfc-0612-4ad2-9b55-0ebd95228592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:24.160412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc99bfc-0612-4ad2-9b55-0ebd95228592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.162021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc99bfc-0612-4ad2-9b55-0ebd95228592 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.164744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 774/1558] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:24.165635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145255c8-f46d-431f-96b3-f7b810ddcafc None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.176088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145255c8-f46d-431f-96b3-f7b810ddcafc None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.178675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 785/1559] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:24.179853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0768d6-1026-4fc9-8aac-d7f94d36ce41 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.180138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0768d6-1026-4fc9-8aac-d7f94d36ce41 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.180448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0768d6-1026-4fc9-8aac-d7f94d36ce41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.187790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737dd43-22db-4a7f-be5e-44cbad75e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.188537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737dd43-22db-4a7f-be5e-44cbad75e83b admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.188823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737dd43-22db-4a7f-be5e-44cbad75e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.189097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737dd43-22db-4a7f-be5e-44cbad75e83b admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.189792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737dd43-22db-4a7f-be5e-44cbad75e83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.190818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WARNING py.warnings [None req-9737dd43-22db-4a7f-be5e-44cbad75e83b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:45:24.190818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: warnings.warn(msg) May 23 16:45:24.190818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: May 23 16:45:24.192050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737dd43-22db-4a7f-be5e-44cbad75e83b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.201918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-ca0768d6-1026-4fc9-8aac-d7f94d36ce41 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:24.202421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ca0768d6-1026-4fc9-8aac-d7f94d36ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:24.210715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 786/1560] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:24.217625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0768d6-1026-4fc9-8aac-d7f94d36ce41 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.223790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0768d6-1026-4fc9-8aac-d7f94d36ce41 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.228432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4ac6f-bd97-4542-a493-0dc95f15bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.229127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4ac6f-bd97-4542-a493-0dc95f15bf3a admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.229413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4ac6f-bd97-4542-a493-0dc95f15bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.229689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4ac6f-bd97-4542-a493-0dc95f15bf3a admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.231010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4ac6f-bd97-4542-a493-0dc95f15bf3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.233035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4ac6f-bd97-4542-a493-0dc95f15bf3a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.242557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:24.311699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 775/1561] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:24.312589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737dd43-22db-4a7f-be5e-44cbad75e83b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.321957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737dd43-22db-4a7f-be5e-44cbad75e83b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.326690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac7a93-3dbd-425d-b535-b838b1e408ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.327324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac7a93-3dbd-425d-b535-b838b1e408ac admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.327609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac7a93-3dbd-425d-b535-b838b1e408ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.327886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac7a93-3dbd-425d-b535-b838b1e408ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.328636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac7a93-3dbd-425d-b535-b838b1e408ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:24.328948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac7a93-3dbd-425d-b535-b838b1e408ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.330803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac7a93-3dbd-425d-b535-b838b1e408ac admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.343223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 776/1562] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:24.344037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac7a93-3dbd-425d-b535-b838b1e408ac admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.350361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 787/1563] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:24.350361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4ac6f-bd97-4542-a493-0dc95f15bf3a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.357706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac7a93-3dbd-425d-b535-b838b1e408ac admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.360764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4ac6f-bd97-4542-a493-0dc95f15bf3a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.361537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44a23e-b173-49c9-9c8f-762b79c66a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.362225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44a23e-b173-49c9-9c8f-762b79c66a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.362511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44a23e-b173-49c9-9c8f-762b79c66a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.362794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44a23e-b173-49c9-9c8f-762b79c66a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.363517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44a23e-b173-49c9-9c8f-762b79c66a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:24.363823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44a23e-b173-49c9-9c8f-762b79c66a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.365334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800347b-4d99-4672-aaf9-5b09df9cc814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.365479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44a23e-b173-49c9-9c8f-762b79c66a8d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.365980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800347b-4d99-4672-aaf9-5b09df9cc814 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.366389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800347b-4d99-4672-aaf9-5b09df9cc814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.366649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800347b-4d99-4672-aaf9-5b09df9cc814 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.367336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800347b-4d99-4672-aaf9-5b09df9cc814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.369250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800347b-4d99-4672-aaf9-5b09df9cc814 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.377451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 777/1564] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:24.378693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87ce67-6075-44ec-a4a3-e9e3d0d46db8 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.378993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87ce67-6075-44ec-a4a3-e9e3d0d46db8 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.379265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87ce67-6075-44ec-a4a3-e9e3d0d46db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.397154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-3a87ce67-6075-44ec-a4a3-e9e3d0d46db8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:24.398499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3a87ce67-6075-44ec-a4a3-e9e3d0d46db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:24.407293 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 778/1565] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:24.408038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87ce67-6075-44ec-a4a3-e9e3d0d46db8 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.417270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87ce67-6075-44ec-a4a3-e9e3d0d46db8 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.426493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dce26-463f-499d-a88c-07724f335342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.426493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dce26-463f-499d-a88c-07724f335342 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.426493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dce26-463f-499d-a88c-07724f335342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.426493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dce26-463f-499d-a88c-07724f335342 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.426879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dce26-463f-499d-a88c-07724f335342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.426879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dce26-463f-499d-a88c-07724f335342 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.490306 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 788/1566] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:24.491135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800347b-4d99-4672-aaf9-5b09df9cc814 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.519794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:24.528536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 779/1567] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:24.528536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dce26-463f-499d-a88c-07724f335342 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.557723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800347b-4d99-4672-aaf9-5b09df9cc814 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.590718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dce26-463f-499d-a88c-07724f335342 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.595359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5c6b1-54d6-4728-954b-8b6bc8d07117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.596029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5c6b1-54d6-4728-954b-8b6bc8d07117 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.596339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5c6b1-54d6-4728-954b-8b6bc8d07117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.596626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5c6b1-54d6-4728-954b-8b6bc8d07117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.597477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5c6b1-54d6-4728-954b-8b6bc8d07117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.599106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5c6b1-54d6-4728-954b-8b6bc8d07117 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.609114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 780/1568] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:24.609915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5c6b1-54d6-4728-954b-8b6bc8d07117 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.619416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d8a1b-63e6-4d60-b15f-7373d9306c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.619416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d8a1b-63e6-4d60-b15f-7373d9306c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.619416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d8a1b-63e6-4d60-b15f-7373d9306c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.619416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d8a1b-63e6-4d60-b15f-7373d9306c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.620001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d8a1b-63e6-4d60-b15f-7373d9306c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:24.620001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d8a1b-63e6-4d60-b15f-7373d9306c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.620001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d8a1b-63e6-4d60-b15f-7373d9306c7d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.621984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5c6b1-54d6-4728-954b-8b6bc8d07117 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.626604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a40e8-8898-4255-a37c-a90ad8f3a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.627273 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a40e8-8898-4255-a37c-a90ad8f3a863 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.627562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a40e8-8898-4255-a37c-a90ad8f3a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.627839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a40e8-8898-4255-a37c-a90ad8f3a863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.628561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a40e8-8898-4255-a37c-a90ad8f3a863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.630503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a40e8-8898-4255-a37c-a90ad8f3a863 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.630861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 789/1569] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:24.631673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d8a1b-63e6-4d60-b15f-7373d9306c7d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.643624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d8a1b-63e6-4d60-b15f-7373d9306c7d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.649112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdb2c5-79ea-4021-9911-5102077baa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.650804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdb2c5-79ea-4021-9911-5102077baa0f admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.650804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdb2c5-79ea-4021-9911-5102077baa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.650804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdb2c5-79ea-4021-9911-5102077baa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.651097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdb2c5-79ea-4021-9911-5102077baa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.653298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdb2c5-79ea-4021-9911-5102077baa0f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.665572 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 790/1570] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:24.670569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdb2c5-79ea-4021-9911-5102077baa0f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.677505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdb2c5-79ea-4021-9911-5102077baa0f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.682054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1fe53-a185-411a-8a2b-774afc7c94e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.682702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1fe53-a185-411a-8a2b-774afc7c94e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.682989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1fe53-a185-411a-8a2b-774afc7c94e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.683333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1fe53-a185-411a-8a2b-774afc7c94e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.684216 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1fe53-a185-411a-8a2b-774afc7c94e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.686154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1fe53-a185-411a-8a2b-774afc7c94e2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.748083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 781/1571] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:24.748999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a40e8-8898-4255-a37c-a90ad8f3a863 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.791223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 791/1572] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:24.791223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1fe53-a185-411a-8a2b-774afc7c94e2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.811000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a40e8-8898-4255-a37c-a90ad8f3a863 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.834334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:24.853440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1fe53-a185-411a-8a2b-774afc7c94e2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.858077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba0ea6-c989-494e-95d5-162fc18e9c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.858743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba0ea6-c989-494e-95d5-162fc18e9c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.859024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba0ea6-c989-494e-95d5-162fc18e9c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.859302 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba0ea6-c989-494e-95d5-162fc18e9c14 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.859987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba0ea6-c989-494e-95d5-162fc18e9c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.861970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba0ea6-c989-494e-95d5-162fc18e9c14 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.867258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbba54-e105-4218-91fc-8efaf0f7e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.867931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbba54-e105-4218-91fc-8efaf0f7e356 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.868216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbba54-e105-4218-91fc-8efaf0f7e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.868534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbba54-e105-4218-91fc-8efaf0f7e356 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.874576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbba54-e105-4218-91fc-8efaf0f7e356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:24.874576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbba54-e105-4218-91fc-8efaf0f7e356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.874576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbba54-e105-4218-91fc-8efaf0f7e356 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.883243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 782/1573] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:24.884025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbba54-e105-4218-91fc-8efaf0f7e356 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:24.894248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbba54-e105-4218-91fc-8efaf0f7e356 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:24.898742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989c299-b5b5-4788-80f7-062495ec64c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:24.899371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989c299-b5b5-4788-80f7-062495ec64c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:24.899657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989c299-b5b5-4788-80f7-062495ec64c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:24.899932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989c299-b5b5-4788-80f7-062495ec64c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:24.900641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989c299-b5b5-4788-80f7-062495ec64c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:24.902591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989c299-b5b5-4788-80f7-062495ec64c1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:24.999139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 792/1574] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:24.999835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba0ea6-c989-494e-95d5-162fc18e9c14 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.009089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba0ea6-c989-494e-95d5-162fc18e9c14 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.014758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965184-0762-4ac3-9a95-cbd9145f104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.015415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965184-0762-4ac3-9a95-cbd9145f104f admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.015702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965184-0762-4ac3-9a95-cbd9145f104f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.015984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965184-0762-4ac3-9a95-cbd9145f104f admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.016744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965184-0762-4ac3-9a95-cbd9145f104f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.018367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965184-0762-4ac3-9a95-cbd9145f104f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.021479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:25.027561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 783/1575] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:24 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:25.028379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989c299-b5b5-4788-80f7-062495ec64c1 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.033690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 793/1576] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.033690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965184-0762-4ac3-9a95-cbd9145f104f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.037928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989c299-b5b5-4788-80f7-062495ec64c1 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.041532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965184-0762-4ac3-9a95-cbd9145f104f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.042939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3801fd5-4426-4307-813f-044897091d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.043717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3801fd5-4426-4307-813f-044897091d6d admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.044398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3801fd5-4426-4307-813f-044897091d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.044398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3801fd5-4426-4307-813f-044897091d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.045005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3801fd5-4426-4307-813f-044897091d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.046392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b535b9-3df8-48bf-8e8f-7984003fa9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.046927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3801fd5-4426-4307-813f-044897091d6d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.047042 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b535b9-3df8-48bf-8e8f-7984003fa9ea admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.047305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b535b9-3df8-48bf-8e8f-7984003fa9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.047580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b535b9-3df8-48bf-8e8f-7984003fa9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.048313 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b535b9-3df8-48bf-8e8f-7984003fa9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.049976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b535b9-3df8-48bf-8e8f-7984003fa9ea admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.060920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 794/1577] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.061846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b535b9-3df8-48bf-8e8f-7984003fa9ea admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.072266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b535b9-3df8-48bf-8e8f-7984003fa9ea admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.077679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89756ea-a1b8-429d-b4cf-397485cd9fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.078350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89756ea-a1b8-429d-b4cf-397485cd9fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.078638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89756ea-a1b8-429d-b4cf-397485cd9fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.078965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89756ea-a1b8-429d-b4cf-397485cd9fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.079659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89756ea-a1b8-429d-b4cf-397485cd9fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.081952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89756ea-a1b8-429d-b4cf-397485cd9fa5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.130684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 784/1578] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:25 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:25.131504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3801fd5-4426-4307-813f-044897091d6d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.153290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 795/1579] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:25 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:25.154098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89756ea-a1b8-429d-b4cf-397485cd9fa5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.164114 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89756ea-a1b8-429d-b4cf-397485cd9fa5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.202323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3801fd5-4426-4307-813f-044897091d6d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.207318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e321a3-6916-4f5c-8634-cf766544d884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.208119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e321a3-6916-4f5c-8634-cf766544d884 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.208441 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e321a3-6916-4f5c-8634-cf766544d884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.208725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e321a3-6916-4f5c-8634-cf766544d884 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.209468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e321a3-6916-4f5c-8634-cf766544d884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.211402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e321a3-6916-4f5c-8634-cf766544d884 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.221862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e854cd-09d4-4c51-af5a-1db4c95c4d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.222650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e854cd-09d4-4c51-af5a-1db4c95c4d3d admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.222932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e854cd-09d4-4c51-af5a-1db4c95c4d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.223241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e854cd-09d4-4c51-af5a-1db4c95c4d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.223927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e854cd-09d4-4c51-af5a-1db4c95c4d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.225903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e854cd-09d4-4c51-af5a-1db4c95c4d3d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.326805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 785/1580] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:25 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:25.326805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e321a3-6916-4f5c-8634-cf766544d884 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.334991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e321a3-6916-4f5c-8634-cf766544d884 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.336719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 796/1581] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:25 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:25.337626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e854cd-09d4-4c51-af5a-1db4c95c4d3d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.395301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ec0ba-30f5-4a99-9fbe-7470c4feece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.395883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ec0ba-30f5-4a99-9fbe-7470c4feece1 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.396176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ec0ba-30f5-4a99-9fbe-7470c4feece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.396485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ec0ba-30f5-4a99-9fbe-7470c4feece1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.397213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ec0ba-30f5-4a99-9fbe-7470c4feece1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.398826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ec0ba-30f5-4a99-9fbe-7470c4feece1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.402314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e854cd-09d4-4c51-af5a-1db4c95c4d3d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.406915 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d185f8-2d88-4771-ae22-fb953454f06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.407579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d185f8-2d88-4771-ae22-fb953454f06c admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.407867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d185f8-2d88-4771-ae22-fb953454f06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.408141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d185f8-2d88-4771-ae22-fb953454f06c admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.408764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 786/1582] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.408893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d185f8-2d88-4771-ae22-fb953454f06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.409675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ec0ba-30f5-4a99-9fbe-7470c4feece1 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.410481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d185f8-2d88-4771-ae22-fb953454f06c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.420143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ec0ba-30f5-4a99-9fbe-7470c4feece1 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.421770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 797/1583] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.422573 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d185f8-2d88-4771-ae22-fb953454f06c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.425175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa4d5-6a6f-43b4-9881-11622908c7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.426059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa4d5-6a6f-43b4-9881-11622908c7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.426341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa4d5-6a6f-43b4-9881-11622908c7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.426618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa4d5-6a6f-43b4-9881-11622908c7e3 admin admin] PATH_INFO: `/v3/projects/c124de0ad7364125b9d749ec4aaf7e77/users/a10a0e21bd094229bb111d08487875c9/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.432077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d185f8-2d88-4771-ae22-fb953454f06c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.437156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20da50-3c01-4162-bd27-662ef42df546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.438026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20da50-3c01-4162-bd27-662ef42df546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.438309 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20da50-3c01-4162-bd27-662ef42df546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.438581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20da50-3c01-4162-bd27-662ef42df546 admin admin] PATH_INFO: `/v3/projects/e293f2b3de9143ad9e8a1fe8b67d6641/users/718a82d2f4294f68965ce01aac0fc166/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.442155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aa4d5-6a6f-43b4-9881-11622908c7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c124de0ad7364125b9d749ec4aaf7e77, user_id=a10a0e21bd094229bb111d08487875c9, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.444894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aa4d5-6a6f-43b4-9881-11622908c7e3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.450538 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:25.454562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20da50-3c01-4162-bd27-662ef42df546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e293f2b3de9143ad9e8a1fe8b67d6641, user_id=718a82d2f4294f68965ce01aac0fc166, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.455920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WARNING py.warnings [None req-ea20da50-3c01-4162-bd27-662ef42df546 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:45:25.455920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: warnings.warn(msg) May 23 16:45:25.455920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: May 23 16:45:25.459433 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20da50-3c01-4162-bd27-662ef42df546 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.563223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 787/1584] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:25 2022] PUT /identity/v3/projects/c124de0ad7364125b9d749ec4aaf7e77/users/a10a0e21bd094229bb111d08487875c9/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:25.564066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa4d5-6a6f-43b4-9881-11622908c7e3 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.598215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 798/1585] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:25 2022] PUT /identity/v3/projects/e293f2b3de9143ad9e8a1fe8b67d6641/users/718a82d2f4294f68965ce01aac0fc166/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:25.599056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20da50-3c01-4162-bd27-662ef42df546 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.604239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:25.626436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa4d5-6a6f-43b4-9881-11622908c7e3 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.663598 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20da50-3c01-4162-bd27-662ef42df546 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.668830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be15845-e79b-4ad4-8fc4-110a2f1811a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.669500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be15845-e79b-4ad4-8fc4-110a2f1811a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.669779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be15845-e79b-4ad4-8fc4-110a2f1811a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.670052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be15845-e79b-4ad4-8fc4-110a2f1811a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.670773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be15845-e79b-4ad4-8fc4-110a2f1811a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.672397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be15845-e79b-4ad4-8fc4-110a2f1811a2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.682477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 799/1586] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.683397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be15845-e79b-4ad4-8fc4-110a2f1811a2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.687124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8d218-9e18-4f2e-9b05-856a2a6deda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.687834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8d218-9e18-4f2e-9b05-856a2a6deda6 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.693701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8d218-9e18-4f2e-9b05-856a2a6deda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.693701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8d218-9e18-4f2e-9b05-856a2a6deda6 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.693701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8d218-9e18-4f2e-9b05-856a2a6deda6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.693701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8d218-9e18-4f2e-9b05-856a2a6deda6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.694680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be15845-e79b-4ad4-8fc4-110a2f1811a2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.699155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e1207-0b64-4c34-9c45-119f76bb0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.699865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e1207-0b64-4c34-9c45-119f76bb0c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.700146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e1207-0b64-4c34-9c45-119f76bb0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.700456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e1207-0b64-4c34-9c45-119f76bb0c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.701169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e1207-0b64-4c34-9c45-119f76bb0c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.702745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e1207-0b64-4c34-9c45-119f76bb0c76 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.713057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 800/1587] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.713844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e1207-0b64-4c34-9c45-119f76bb0c76 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.724015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e1207-0b64-4c34-9c45-119f76bb0c76 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.728543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eb41c-643f-407f-bd39-46c137939242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.729163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eb41c-643f-407f-bd39-46c137939242 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.729440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eb41c-643f-407f-bd39-46c137939242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.729714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eb41c-643f-407f-bd39-46c137939242 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.731079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eb41c-643f-407f-bd39-46c137939242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.732964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eb41c-643f-407f-bd39-46c137939242 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.769414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 788/1588] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:25 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:25.770087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8d218-9e18-4f2e-9b05-856a2a6deda6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.780273 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8d218-9e18-4f2e-9b05-856a2a6deda6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.785029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980092f3-605f-4b77-87dc-a9861e257d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.785665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980092f3-605f-4b77-87dc-a9861e257d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.785948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980092f3-605f-4b77-87dc-a9861e257d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.786225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980092f3-605f-4b77-87dc-a9861e257d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.786958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980092f3-605f-4b77-87dc-a9861e257d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.788577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980092f3-605f-4b77-87dc-a9861e257d01 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.799577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 789/1589] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.800561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980092f3-605f-4b77-87dc-a9861e257d01 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.810085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980092f3-605f-4b77-87dc-a9861e257d01 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.814950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561b85b-0819-4506-9346-daf6a00f463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.815632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561b85b-0819-4506-9346-daf6a00f463a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.815922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561b85b-0819-4506-9346-daf6a00f463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.816205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561b85b-0819-4506-9346-daf6a00f463a admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.816973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561b85b-0819-4506-9346-daf6a00f463a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.818561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561b85b-0819-4506-9346-daf6a00f463a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.826663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 801/1590] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:25 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:25.827952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdbef4-b525-4908-a330-fe34810197aa None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.828223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdbef4-b525-4908-a330-fe34810197aa None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.828525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdbef4-b525-4908-a330-fe34810197aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.830656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 790/1591] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.832114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792efcae-6b66-4983-9655-e14b51358892 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.832446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792efcae-6b66-4983-9655-e14b51358892 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.837266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792efcae-6b66-4983-9655-e14b51358892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.850572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-792efcae-6b66-4983-9655-e14b51358892 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:25.851841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-792efcae-6b66-4983-9655-e14b51358892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:25.858805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2acdbef4-b525-4908-a330-fe34810197aa None None] MFA Rules not processed for user `a10a0e21bd094229bb111d08487875c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:25.859995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2acdbef4-b525-4908-a330-fe34810197aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:25.860783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 791/1592] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:25.861577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792efcae-6b66-4983-9655-e14b51358892 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.875251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792efcae-6b66-4983-9655-e14b51358892 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.880048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f110d-c90b-46a1-8b62-f70a72da1e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.880759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f110d-c90b-46a1-8b62-f70a72da1e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.881036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f110d-c90b-46a1-8b62-f70a72da1e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.881307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f110d-c90b-46a1-8b62-f70a72da1e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.882028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f110d-c90b-46a1-8b62-f70a72da1e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.883656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f110d-c90b-46a1-8b62-f70a72da1e1d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.893975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 792/1593] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.894776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f110d-c90b-46a1-8b62-f70a72da1e1d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.904618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f110d-c90b-46a1-8b62-f70a72da1e1d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.909272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd8f5e-e519-4d32-965b-45f652f12e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.909908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd8f5e-e519-4d32-965b-45f652f12e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.910190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd8f5e-e519-4d32-965b-45f652f12e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.910460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd8f5e-e519-4d32-965b-45f652f12e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.911206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd8f5e-e519-4d32-965b-45f652f12e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.912819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd8f5e-e519-4d32-965b-45f652f12e88 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.927156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 793/1594] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.927156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd8f5e-e519-4d32-965b-45f652f12e88 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.932731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 802/1595] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:25.933898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdbef4-b525-4908-a330-fe34810197aa None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.934209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd8f5e-e519-4d32-965b-45f652f12e88 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.939969 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17998773-f561-47c6-a446-017af5f0193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.940603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17998773-f561-47c6-a446-017af5f0193a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.940885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17998773-f561-47c6-a446-017af5f0193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.941157 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17998773-f561-47c6-a446-017af5f0193a admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.941871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17998773-f561-47c6-a446-017af5f0193a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.943446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17998773-f561-47c6-a446-017af5f0193a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.946953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdbef4-b525-4908-a330-fe34810197aa None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.951659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccd6da-5123-483d-ac5e-cf6385b7d901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.952569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccd6da-5123-483d-ac5e-cf6385b7d901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.952851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccd6da-5123-483d-ac5e-cf6385b7d901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.953128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccd6da-5123-483d-ac5e-cf6385b7d901 admin admin] PATH_INFO: `/v3/projects/d63172a733e14d2693542d08f148fb26/users/c3854d70b6ec4c6b87f36f55f1fe0323/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.956841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 794/1596] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.956841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17998773-f561-47c6-a446-017af5f0193a admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.964006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17998773-f561-47c6-a446-017af5f0193a admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:25.969350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57645f5-34fc-4cca-9f2d-d88a792b8cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:25.969992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57645f5-34fc-4cca-9f2d-d88a792b8cac admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:25.970340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57645f5-34fc-4cca-9f2d-d88a792b8cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:25.970537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57645f5-34fc-4cca-9f2d-d88a792b8cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:25.971247 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57645f5-34fc-4cca-9f2d-d88a792b8cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.971756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccd6da-5123-483d-ac5e-cf6385b7d901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63172a733e14d2693542d08f148fb26, user_id=c3854d70b6ec4c6b87f36f55f1fe0323, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:25.972941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57645f5-34fc-4cca-9f2d-d88a792b8cac admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.976152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccd6da-5123-483d-ac5e-cf6385b7d901 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:25.987907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 795/1597] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:25.988883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57645f5-34fc-4cca-9f2d-d88a792b8cac admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:25.998950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57645f5-34fc-4cca-9f2d-d88a792b8cac admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.003647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2714-70bb-41f2-9052-3758657ef9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.004527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2714-70bb-41f2-9052-3758657ef9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.004821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2714-70bb-41f2-9052-3758657ef9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.005103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2714-70bb-41f2-9052-3758657ef9a2 admin admin] PATH_INFO: `/v3/projects/8c4eba5d39e545cbb8380490c86045f0/users/f14f77bc65fd4ff0bc1ec6de35846f14/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.020855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2714-70bb-41f2-9052-3758657ef9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4eba5d39e545cbb8380490c86045f0, user_id=f14f77bc65fd4ff0bc1ec6de35846f14, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.023583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2714-70bb-41f2-9052-3758657ef9a2 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.043380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 803/1598] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:25 2022] PUT /identity/v3/projects/d63172a733e14d2693542d08f148fb26/users/c3854d70b6ec4c6b87f36f55f1fe0323/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:26.044205 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccd6da-5123-483d-ac5e-cf6385b7d901 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.072654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:26.083747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 796/1599] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:25 2022] PUT /identity/v3/projects/8c4eba5d39e545cbb8380490c86045f0/users/f14f77bc65fd4ff0bc1ec6de35846f14/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:26.084594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2714-70bb-41f2-9052-3758657ef9a2 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.105108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccd6da-5123-483d-ac5e-cf6385b7d901 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.127385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:26.149267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2714-70bb-41f2-9052-3758657ef9a2 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.155129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b344ad-85a7-4bfe-b890-296b684580b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.155325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a5ff-e1a7-4728-a599-b6f3525578cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.155827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b344ad-85a7-4bfe-b890-296b684580b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.156064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a5ff-e1a7-4728-a599-b6f3525578cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.156178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b344ad-85a7-4bfe-b890-296b684580b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.156391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a5ff-e1a7-4728-a599-b6f3525578cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.156497 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b344ad-85a7-4bfe-b890-296b684580b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.156676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a5ff-e1a7-4728-a599-b6f3525578cc admin admin] PATH_INFO: `/v3/projects/60f9f16bd2494b7999c25509f804d794/users/29e2a2fa32cd4fb7837bdec1d83cb9da/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.165659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b344ad-85a7-4bfe-b890-296b684580b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.167109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b344ad-85a7-4bfe-b890-296b684580b4 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.172087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574a5ff-e1a7-4728-a599-b6f3525578cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f9f16bd2494b7999c25509f804d794, user_id=29e2a2fa32cd4fb7837bdec1d83cb9da, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.175276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574a5ff-e1a7-4728-a599-b6f3525578cc admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.176738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 804/1600] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:26.177565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b344ad-85a7-4bfe-b890-296b684580b4 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.186654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b344ad-85a7-4bfe-b890-296b684580b4 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.191867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75328a-9a0c-42f4-b153-7b038d72bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.192788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75328a-9a0c-42f4-b153-7b038d72bdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.197254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75328a-9a0c-42f4-b153-7b038d72bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.197254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75328a-9a0c-42f4-b153-7b038d72bdb0 admin admin] PATH_INFO: `/v3/projects/74e33cc37cea457aa637d73dbc4e141d/users/0f018c1bdf2c43d59ae6f73b145665cc/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.209498 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75328a-9a0c-42f4-b153-7b038d72bdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e33cc37cea457aa637d73dbc4e141d, user_id=0f018c1bdf2c43d59ae6f73b145665cc, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.212185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75328a-9a0c-42f4-b153-7b038d72bdb0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.249750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 797/1601] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:26 2022] PUT /identity/v3/projects/60f9f16bd2494b7999c25509f804d794/users/29e2a2fa32cd4fb7837bdec1d83cb9da/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:26.256013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a5ff-e1a7-4728-a599-b6f3525578cc admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.308267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a5ff-e1a7-4728-a599-b6f3525578cc admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.312448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87687039-99ba-48e1-b0c5-9803065179c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.314587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87687039-99ba-48e1-b0c5-9803065179c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.314587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87687039-99ba-48e1-b0c5-9803065179c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.314587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87687039-99ba-48e1-b0c5-9803065179c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.359747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 805/1602] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:26 2022] PUT /identity/v3/projects/74e33cc37cea457aa637d73dbc4e141d/users/0f018c1bdf2c43d59ae6f73b145665cc/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:26.360810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75328a-9a0c-42f4-b153-7b038d72bdb0 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.380239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87687039-99ba-48e1-b0c5-9803065179c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.381769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87687039-99ba-48e1-b0c5-9803065179c5 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.391281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 798/1603] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:26.392163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87687039-99ba-48e1-b0c5-9803065179c5 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.442645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75328a-9a0c-42f4-b153-7b038d72bdb0 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.448037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddde7b-dcec-44e7-bb33-e31cac94e3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.456828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddde7b-dcec-44e7-bb33-e31cac94e3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.456828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddde7b-dcec-44e7-bb33-e31cac94e3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.456828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddde7b-dcec-44e7-bb33-e31cac94e3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.456828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddde7b-dcec-44e7-bb33-e31cac94e3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.456828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddde7b-dcec-44e7-bb33-e31cac94e3fc admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.463560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 806/1604] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:26.466581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ad1ac-724a-4abf-9490-05c50fc39851 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.466738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ad1ac-724a-4abf-9490-05c50fc39851 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.467024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ad1ac-724a-4abf-9490-05c50fc39851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.478019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87687039-99ba-48e1-b0c5-9803065179c5 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.486130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec820a9-486d-458c-afa3-b5b3f5773b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.486956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec820a9-486d-458c-afa3-b5b3f5773b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.487341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec820a9-486d-458c-afa3-b5b3f5773b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.487688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec820a9-486d-458c-afa3-b5b3f5773b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.488880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec820a9-486d-458c-afa3-b5b3f5773b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.490974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec820a9-486d-458c-afa3-b5b3f5773b06 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.506665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d45ad1ac-724a-4abf-9490-05c50fc39851 None None] MFA Rules not processed for user `c3854d70b6ec4c6b87f36f55f1fe0323`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:26.506665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d45ad1ac-724a-4abf-9490-05c50fc39851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:26.507536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 799/1605] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:26.509302 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52863d-32d7-4e6f-8091-3e8932efe794 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.509680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52863d-32d7-4e6f-8091-3e8932efe794 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.510040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52863d-32d7-4e6f-8091-3e8932efe794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.544576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5a52863d-32d7-4e6f-8091-3e8932efe794 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:26.544576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5a52863d-32d7-4e6f-8091-3e8932efe794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:26.559696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 800/1606] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:26.559696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacd687-cc77-4339-917a-6524757a2eb4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.560636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacd687-cc77-4339-917a-6524757a2eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.560636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacd687-cc77-4339-917a-6524757a2eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.572041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:26.584949 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:26.590556 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8dacd687-cc77-4339-917a-6524757a2eb4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:26.592406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8dacd687-cc77-4339-917a-6524757a2eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:26.604410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 801/1607] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:26.609708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77385adf-06dd-4758-b314-4c54bde3350d None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.610101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77385adf-06dd-4758-b314-4c54bde3350d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.615581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77385adf-06dd-4758-b314-4c54bde3350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.625289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 807/1608] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:26.626371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ad1ac-724a-4abf-9490-05c50fc39851 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.639420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ad1ac-724a-4abf-9490-05c50fc39851 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.644798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdc93-ce70-4bbe-bab5-a9437918d8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.650035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-77385adf-06dd-4758-b314-4c54bde3350d None None] MFA Rules not processed for user `0f018c1bdf2c43d59ae6f73b145665cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:26.650176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdc93-ce70-4bbe-bab5-a9437918d8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.650176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdc93-ce70-4bbe-bab5-a9437918d8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.650176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdc93-ce70-4bbe-bab5-a9437918d8e3 admin admin] PATH_INFO: `/v3/projects/fc5c77313d114be8a334b6009147d627/users/8d7100e6b15442e895c72cb41116e76b/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.650435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-77385adf-06dd-4758-b314-4c54bde3350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:26.664859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bdc93-ce70-4bbe-bab5-a9437918d8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5c77313d114be8a334b6009147d627, user_id=8d7100e6b15442e895c72cb41116e76b, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.668335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bdc93-ce70-4bbe-bab5-a9437918d8e3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.718936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 802/1609] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:26.718936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77385adf-06dd-4758-b314-4c54bde3350d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.727120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77385adf-06dd-4758-b314-4c54bde3350d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.733639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0ee63-5fa3-4090-a97c-a6140435aea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.734688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0ee63-5fa3-4090-a97c-a6140435aea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.735048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0ee63-5fa3-4090-a97c-a6140435aea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.735392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0ee63-5fa3-4090-a97c-a6140435aea2 admin admin] PATH_INFO: `/v3/projects/c14a96662507495b84670e2f62f90f59/users/0e90497b6d9c4a789f6b31680e069087/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.752941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0ee63-5fa3-4090-a97c-a6140435aea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14a96662507495b84670e2f62f90f59, user_id=0e90497b6d9c4a789f6b31680e069087, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.755927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0ee63-5fa3-4090-a97c-a6140435aea2 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.776527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 808/1610] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:26 2022] PUT /identity/v3/projects/fc5c77313d114be8a334b6009147d627/users/8d7100e6b15442e895c72cb41116e76b/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:26.778547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdc93-ce70-4bbe-bab5-a9437918d8e3 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.836394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdc93-ce70-4bbe-bab5-a9437918d8e3 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.840284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ea358-d718-4941-890e-9fe83c292bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.841075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ea358-d718-4941-890e-9fe83c292bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.841365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ea358-d718-4941-890e-9fe83c292bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.841645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ea358-d718-4941-890e-9fe83c292bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.880688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 803/1611] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:26 2022] PUT /identity/v3/projects/c14a96662507495b84670e2f62f90f59/users/0e90497b6d9c4a789f6b31680e069087/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:26.881594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0ee63-5fa3-4090-a97c-a6140435aea2 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.910505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ea358-d718-4941-890e-9fe83c292bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:26.914674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ea358-d718-4941-890e-9fe83c292bf2 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:26.927576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 809/1612] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:26.928475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ea358-d718-4941-890e-9fe83c292bf2 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:26.938802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ea358-d718-4941-890e-9fe83c292bf2 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.965225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0ee63-5fa3-4090-a97c-a6140435aea2 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:26.969137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf0b0c-5eda-4a16-97d4-396ab46a1b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.969849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0b0c-5eda-4a16-97d4-396ab46a1b53 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.970131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0b0c-5eda-4a16-97d4-396ab46a1b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.970460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0b0c-5eda-4a16-97d4-396ab46a1b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.997610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd68a-4efb-4d8e-aa2c-d3406c6ce27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:26.998283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd68a-4efb-4d8e-aa2c-d3406c6ce27b admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:26.998570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd68a-4efb-4d8e-aa2c-d3406c6ce27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:26.998850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd68a-4efb-4d8e-aa2c-d3406c6ce27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:26.999544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcd68a-4efb-4d8e-aa2c-d3406c6ce27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:27.001503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcd68a-4efb-4d8e-aa2c-d3406c6ce27b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:27.033671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf0b0c-5eda-4a16-97d4-396ab46a1b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:27.035156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf0b0c-5eda-4a16-97d4-396ab46a1b53 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:27.045548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 804/1613] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:27.046875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c405-7289-4154-aa01-f106b66bdd89 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.047202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c405-7289-4154-aa01-f106b66bdd89 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.047494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c405-7289-4154-aa01-f106b66bdd89 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.048813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 805/1614] 10.222.0.74 () {54 vars in 961 bytes} [Mon May 23 16:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:45:27.049938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea894-42bd-45a1-853a-9e77be7c5f04 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.050323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea894-42bd-45a1-853a-9e77be7c5f04 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.050603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea894-42bd-45a1-853a-9e77be7c5f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.069990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-ea9ea894-42bd-45a1-853a-9e77be7c5f04 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:27.071263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ea9ea894-42bd-45a1-853a-9e77be7c5f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:27.083554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 806/1615] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:27.083554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25514589-f840-40ce-bc19-93365934e68c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.083554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25514589-f840-40ce-bc19-93365934e68c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.083554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25514589-f840-40ce-bc19-93365934e68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.103419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-25514589-f840-40ce-bc19-93365934e68c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:27.104702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-25514589-f840-40ce-bc19-93365934e68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:27.113390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 807/1616] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:27.114743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b1a2-e3aa-4cb1-970b-f918a4c5cd00 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.115033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b1a2-e3aa-4cb1-970b-f918a4c5cd00 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.115313 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b1a2-e3aa-4cb1-970b-f918a4c5cd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.134904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d314b1a2-e3aa-4cb1-970b-f918a4c5cd00 None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:27.136127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d314b1a2-e3aa-4cb1-970b-f918a4c5cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:27.171723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 810/1617] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:26 2022] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:27.172516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd68a-4efb-4d8e-aa2c-d3406c6ce27b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:27.221089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 808/1618] 10.222.0.74 () {58 vars in 1058 bytes} [Mon May 23 16:45:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:27.221993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b1a2-e3aa-4cb1-970b-f918a4c5cd00 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:27.232706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b1a2-e3aa-4cb1-970b-f918a4c5cd00 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:27.241558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd68a-4efb-4d8e-aa2c-d3406c6ce27b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:27.246127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825f566-c265-4a32-9d8c-8d1733ef8c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:27.246894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825f566-c265-4a32-9d8c-8d1733ef8c78 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.247181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825f566-c265-4a32-9d8c-8d1733ef8c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.247461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825f566-c265-4a32-9d8c-8d1733ef8c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.293135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e1261-f139-481f-97fc-a9b2b1b2a22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:27.294343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e1261-f139-481f-97fc-a9b2b1b2a22c service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.294634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e1261-f139-481f-97fc-a9b2b1b2a22c service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.294971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e1261-f139-481f-97fc-a9b2b1b2a22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.328496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825f566-c265-4a32-9d8c-8d1733ef8c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:27.330238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825f566-c265-4a32-9d8c-8d1733ef8c78 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:27.348498 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 811/1619] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:27.351230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825f566-c265-4a32-9d8c-8d1733ef8c78 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:27.357615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:27.369651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825f566-c265-4a32-9d8c-8d1733ef8c78 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:27.375982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380d695-19b9-4d60-9ff2-2be437a66c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:27.376820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380d695-19b9-4d60-9ff2-2be437a66c03 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.377108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380d695-19b9-4d60-9ff2-2be437a66c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.377733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380d695-19b9-4d60-9ff2-2be437a66c03 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.378442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380d695-19b9-4d60-9ff2-2be437a66c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:27.380758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380d695-19b9-4d60-9ff2-2be437a66c03 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:27.389115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e1261-f139-481f-97fc-a9b2b1b2a22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:27.390919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e1261-f139-481f-97fc-a9b2b1b2a22c service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:27.410167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 809/1620] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:27.411375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e1261-f139-481f-97fc-a9b2b1b2a22c service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:27.472740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:27.493525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e1261-f139-481f-97fc-a9b2b1b2a22c service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:27.499890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e30018-76f1-4eff-92a9-ffbc3e56bf8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:27.500576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e30018-76f1-4eff-92a9-ffbc3e56bf8c service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.500872 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e30018-76f1-4eff-92a9-ffbc3e56bf8c service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.501139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e30018-76f1-4eff-92a9-ffbc3e56bf8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.552101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 812/1621] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:27 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:27.565720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380d695-19b9-4d60-9ff2-2be437a66c03 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:27.594942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e30018-76f1-4eff-92a9-ffbc3e56bf8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:27.596779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e30018-76f1-4eff-92a9-ffbc3e56bf8c service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:27.606774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380d695-19b9-4d60-9ff2-2be437a66c03 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:27.614174 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aae86-8ad3-492f-965a-37ef12c34dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:27.615354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aae86-8ad3-492f-965a-37ef12c34dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.615504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aae86-8ad3-492f-965a-37ef12c34dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.615947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aae86-8ad3-492f-965a-37ef12c34dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.616988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6aae86-8ad3-492f-965a-37ef12c34dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:27.619696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 810/1622] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:27.631492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6aae86-8ad3-492f-965a-37ef12c34dc8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:27.663562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 813/1623] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:27.664630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e30018-76f1-4eff-92a9-ffbc3e56bf8c service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:27.690034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e30018-76f1-4eff-92a9-ffbc3e56bf8c service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:27.707550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6ba8-6028-4db9-a62d-bd3068e72848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:27.711198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6ba8-6028-4db9-a62d-bd3068e72848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:27.711930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6ba8-6028-4db9-a62d-bd3068e72848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:27.712268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6ba8-6028-4db9-a62d-bd3068e72848 admin admin] PATH_INFO: `/v3/projects/4fadd641738c4f7d80b91ee48768c0b4/users/e73034ee13914ffcaec38a8296a0e33e/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:27.763345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad6ba8-6028-4db9-a62d-bd3068e72848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fadd641738c4f7d80b91ee48768c0b4, user_id=e73034ee13914ffcaec38a8296a0e33e, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:27.766079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad6ba8-6028-4db9-a62d-bd3068e72848 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:27.879443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:27.937101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 811/1624] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:27 2022] PUT /identity/v3/projects/4fadd641738c4f7d80b91ee48768c0b4/users/e73034ee13914ffcaec38a8296a0e33e/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:27.941037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aae86-8ad3-492f-965a-37ef12c34dc8 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:27.961576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aae86-8ad3-492f-965a-37ef12c34dc8 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:28.072840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2b7d4-8dc5-4ae6-9a5d-9ef2257e47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:28.072840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2b7d4-8dc5-4ae6-9a5d-9ef2257e47c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.072840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2b7d4-8dc5-4ae6-9a5d-9ef2257e47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.072840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2b7d4-8dc5-4ae6-9a5d-9ef2257e47c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.075597 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2b7d4-8dc5-4ae6-9a5d-9ef2257e47c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:28.079581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2b7d4-8dc5-4ae6-9a5d-9ef2257e47c4 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:28.102896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 814/1625] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:28.112933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6ba8-6028-4db9-a62d-bd3068e72848 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:28.123318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6ba8-6028-4db9-a62d-bd3068e72848 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:28.160806 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be0c6e-e75c-48bd-8679-785db52402e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:28.162056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be0c6e-e75c-48bd-8679-785db52402e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.162460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be0c6e-e75c-48bd-8679-785db52402e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.162864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be0c6e-e75c-48bd-8679-785db52402e8 admin admin] PATH_INFO: `/v3/projects/4fadd641738c4f7d80b91ee48768c0b4/users/e73034ee13914ffcaec38a8296a0e33e/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.167025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be0c6e-e75c-48bd-8679-785db52402e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fadd641738c4f7d80b91ee48768c0b4, user_id=e73034ee13914ffcaec38a8296a0e33e, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:28.172800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be0c6e-e75c-48bd-8679-785db52402e8 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:28.207580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 812/1626] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:28 2022] PUT /identity/v3/projects/4fadd641738c4f7d80b91ee48768c0b4/users/e73034ee13914ffcaec38a8296a0e33e/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:45:28.215329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5a37-a726-4030-a7bf-567d995bcbce None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.215329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5a37-a726-4030-a7bf-567d995bcbce None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.215329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5a37-a726-4030-a7bf-567d995bcbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.250383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:28.259545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-911f5a37-a726-4030-a7bf-567d995bcbce None None] MFA Rules not processed for user `e73034ee13914ffcaec38a8296a0e33e`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:28.260903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-911f5a37-a726-4030-a7bf-567d995bcbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:28.403739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 815/1627] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:28.405012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec935ce-5230-4d35-9d3f-6821354f2f0c None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.405307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec935ce-5230-4d35-9d3f-6821354f2f0c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.405898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec935ce-5230-4d35-9d3f-6821354f2f0c None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.408637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 813/1628] 10.222.0.74 () {54 vars in 961 bytes} [Mon May 23 16:45:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:45:28.418162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f5a37-a726-4030-a7bf-567d995bcbce None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:28.433867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbcb44-cf05-42f5-919e-f9d2da4d6386 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.434202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbcb44-cf05-42f5-919e-f9d2da4d6386 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.434455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbcb44-cf05-42f5-919e-f9d2da4d6386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.459839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-98dbcb44-cf05-42f5-919e-f9d2da4d6386 None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:28.459839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-98dbcb44-cf05-42f5-919e-f9d2da4d6386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:28.581021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f5a37-a726-4030-a7bf-567d995bcbce None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:28.585682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38f23-f7f2-4fe7-bfb1-d7847ba0dd96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:28.586447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38f23-f7f2-4fe7-bfb1-d7847ba0dd96 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.586790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38f23-f7f2-4fe7-bfb1-d7847ba0dd96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.587125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38f23-f7f2-4fe7-bfb1-d7847ba0dd96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.601741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e38f23-f7f2-4fe7-bfb1-d7847ba0dd96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:28.603495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e38f23-f7f2-4fe7-bfb1-d7847ba0dd96 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:28.612620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 814/1629] 10.222.0.74 () {58 vars in 1058 bytes} [Mon May 23 16:45:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:28.619660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793546-c036-44e1-be0e-8c48b9f5d380 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.620016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793546-c036-44e1-be0e-8c48b9f5d380 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.621177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 816/1630] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:28.621284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793546-c036-44e1-be0e-8c48b9f5d380 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.623497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 815/1631] 10.222.0.74 () {54 vars in 912 bytes} [Mon May 23 16:45:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:45:28.632960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71654-8ae6-472f-9fb8-d5324db4589f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.633565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71654-8ae6-472f-9fb8-d5324db4589f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.633565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71654-8ae6-472f-9fb8-d5324db4589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.659739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7ed71654-8ae6-472f-9fb8-d5324db4589f None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:28.661366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7ed71654-8ae6-472f-9fb8-d5324db4589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:28.674054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 817/1632] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:45:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:28.689318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793546-c036-44e1-be0e-8c48b9f5d380 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:28.703619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793546-c036-44e1-be0e-8c48b9f5d380 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:28.709119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ed68e-08c5-4c65-ad99-4173d628fd71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:28.715363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed68e-08c5-4c65-ad99-4173d628fd71 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.715363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed68e-08c5-4c65-ad99-4173d628fd71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.715363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed68e-08c5-4c65-ad99-4173d628fd71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.725043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ed68e-08c5-4c65-ad99-4173d628fd71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:28.726967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ed68e-08c5-4c65-ad99-4173d628fd71 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:28.741029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 816/1633] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:28.874655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970f353-b798-4cad-a2e6-902bd2986e6a None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.881907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970f353-b798-4cad-a2e6-902bd2986e6a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.881907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970f353-b798-4cad-a2e6-902bd2986e6a None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.881907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 818/1634] 10.222.0.74 () {54 vars in 912 bytes} [Mon May 23 16:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:45:28.882788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226a38-9238-470f-a1b2-ab9051e6a8bc None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.883111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226a38-9238-470f-a1b2-ab9051e6a8bc None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.883367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226a38-9238-470f-a1b2-ab9051e6a8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.905417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-96226a38-9238-470f-a1b2-ab9051e6a8bc None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:28.906837 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-96226a38-9238-470f-a1b2-ab9051e6a8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:28.918354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 817/1635] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:45:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:28.932329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970f353-b798-4cad-a2e6-902bd2986e6a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:28.943245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970f353-b798-4cad-a2e6-902bd2986e6a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:28.950365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ac8c-8711-4d54-8b0a-35edbf7e5eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:28.951087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ac8c-8711-4d54-8b0a-35edbf7e5eab service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:28.951383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ac8c-8711-4d54-8b0a-35edbf7e5eab service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:28.951665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ac8c-8711-4d54-8b0a-35edbf7e5eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:28.963905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228ac8c-8711-4d54-8b0a-35edbf7e5eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:28.983735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228ac8c-8711-4d54-8b0a-35edbf7e5eab service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:28.983735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 819/1636] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:29.060559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226a38-9238-470f-a1b2-ab9051e6a8bc None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:29.073057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226a38-9238-470f-a1b2-ab9051e6a8bc None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:29.081288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e89f36-6b06-4d86-bf9f-e72900b5c8b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:29.081288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e89f36-6b06-4d86-bf9f-e72900b5c8b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:29.081288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e89f36-6b06-4d86-bf9f-e72900b5c8b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:29.081617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e89f36-6b06-4d86-bf9f-e72900b5c8b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:29.090503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ac8c-8711-4d54-8b0a-35edbf7e5eab service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:29.100908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:29.160754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e89f36-6b06-4d86-bf9f-e72900b5c8b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:29.162706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e89f36-6b06-4d86-bf9f-e72900b5c8b5 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:29.172746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ac8c-8711-4d54-8b0a-35edbf7e5eab service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:29.172746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:29.172746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:29.172746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:29.173261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] PATH_INFO: `/v3/users/0f018c1bdf2c43d59ae6f73b145665cc` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:29.173261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f018c1bdf2c43d59ae6f73b145665cc)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:29.174133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: WARNING py.warnings [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:45:29.174133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: warnings.warn(msg) May 23 16:45:29.174133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: May 23 16:45:29.175375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:29.176502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 818/1637] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:45:29.706287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334a9a5-b047-4011-9705-6a252236602a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:29.706287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334a9a5-b047-4011-9705-6a252236602a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:29.706287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334a9a5-b047-4011-9705-6a252236602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:29.712529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f018c1bdf2c43d59ae6f73b145665cc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:29.712529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f018c1bdf2c43d59ae6f73b145665cc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:29.715260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-4334a9a5-b047-4011-9705-6a252236602a None None] MFA Rules not processed for user `8d7100e6b15442e895c72cb41116e76b`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:29.715260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4334a9a5-b047-4011-9705-6a252236602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:29.716123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f018c1bdf2c43d59ae6f73b145665cc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:29.716123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f018c1bdf2c43d59ae6f73b145665cc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:29.716659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 819/1638] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:29.726772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5b461-722b-4b20-9f34-26fa9ec567ca None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:29.730633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5b461-722b-4b20-9f34-26fa9ec567ca None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:29.730633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5b461-722b-4b20-9f34-26fa9ec567ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:29.767643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-09e5b461-722b-4b20-9f34-26fa9ec567ca None None] MFA Rules not processed for user `8d7100e6b15442e895c72cb41116e76b`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:29.769426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-09e5b461-722b-4b20-9f34-26fa9ec567ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:29.779530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 820/1639] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:29.797387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5b461-722b-4b20-9f34-26fa9ec567ca None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:29.799303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8f33067f-6116-401a-80a4-f0d0cadad955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f018c1bdf2c43d59ae6f73b145665cc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:29.809360 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 820/1640] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:45:29 2022] DELETE /identity/v3/users/0f018c1bdf2c43d59ae6f73b145665cc => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:29.818432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afffae-97f7-4a61-af8e-8f7d287c2d1c None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:29.819101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afffae-97f7-4a61-af8e-8f7d287c2d1c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:29.820396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afffae-97f7-4a61-af8e-8f7d287c2d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:29.826164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5b461-722b-4b20-9f34-26fa9ec567ca None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:29.862311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-84afffae-97f7-4a61-af8e-8f7d287c2d1c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:29.866796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-84afffae-97f7-4a61-af8e-8f7d287c2d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:29.952458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:29.997906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327119-fe72-459d-b2c5-daefec35d8bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:29.998610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327119-fe72-459d-b2c5-daefec35d8bd service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:29.998885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327119-fe72-459d-b2c5-daefec35d8bd service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:29.999156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327119-fe72-459d-b2c5-daefec35d8bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:30.018736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 821/1641] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:45:30.020665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2f327119-fe72-459d-b2c5-daefec35d8bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:30.021665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afffae-97f7-4a61-af8e-8f7d287c2d1c None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:30.025456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-84afffae-97f7-4a61-af8e-8f7d287c2d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:30.230996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afffae-97f7-4a61-af8e-8f7d287c2d1c None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:30.232093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f327119-fe72-459d-b2c5-daefec35d8bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:30.235036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f327119-fe72-459d-b2c5-daefec35d8bd service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:30.235536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cef2a1-424e-4e62-8137-f95bb6ca8366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:30.236409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cef2a1-424e-4e62-8137-f95bb6ca8366 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:30.236907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cef2a1-424e-4e62-8137-f95bb6ca8366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:30.236907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cef2a1-424e-4e62-8137-f95bb6ca8366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:30.250325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cef2a1-424e-4e62-8137-f95bb6ca8366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:30.251982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cef2a1-424e-4e62-8137-f95bb6ca8366 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:30.261595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 821/1642] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:30.290010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 822/1643] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:30.866282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:31.035827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d122b5-821c-4fe8-91f7-d3c9a9c12a3e None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:31.036116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d122b5-821c-4fe8-91f7-d3c9a9c12a3e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:31.036419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d122b5-821c-4fe8-91f7-d3c9a9c12a3e None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:31.038248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 822/1644] 10.222.0.74 () {54 vars in 912 bytes} [Mon May 23 16:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:45:31.044469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53b566-3e8b-46a8-b977-497a84c15157 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:31.045022 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53b566-3e8b-46a8-b977-497a84c15157 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:31.045022 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53b566-3e8b-46a8-b977-497a84c15157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:31.122603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-fe53b566-3e8b-46a8-b977-497a84c15157 None None] MFA Rules not processed for user `a833149a66af4452aeedd5d43f2fb2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:31.124338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fe53b566-3e8b-46a8-b977-497a84c15157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:31.133577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 823/1645] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:45:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:31.149753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d122b5-821c-4fe8-91f7-d3c9a9c12a3e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:31.172729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d122b5-821c-4fe8-91f7-d3c9a9c12a3e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:31.178471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a3a1-faea-42de-87d1-6df6f83f1697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:31.179501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a3a1-faea-42de-87d1-6df6f83f1697 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:31.179973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a3a1-faea-42de-87d1-6df6f83f1697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:31.180450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a3a1-faea-42de-87d1-6df6f83f1697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:31.208573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61a3a1-faea-42de-87d1-6df6f83f1697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:31.210056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61a3a1-faea-42de-87d1-6df6f83f1697 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:31.242134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 823/1646] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:31.909507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53b566-3e8b-46a8-b977-497a84c15157 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:31.916484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fe53b566-3e8b-46a8-b977-497a84c15157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:31.945826 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53b566-3e8b-46a8-b977-497a84c15157 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:31.958658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:31.959769 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:31.960250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:31.962852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] PATH_INFO: `/v3/projects/74e33cc37cea457aa637d73dbc4e141d` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:31.962852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e33cc37cea457aa637d73dbc4e141d)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:31.966815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:32.024922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:32.128347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a04929-1aa6-44b6-b390-fc9b085ecb11 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:32.129418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a04929-1aa6-44b6-b390-fc9b085ecb11 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:32.129894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a04929-1aa6-44b6-b390-fc9b085ecb11 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:32.131618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 824/1647] 10.222.0.74 () {54 vars in 960 bytes} [Mon May 23 16:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:45:32.144487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e33cc37cea457aa637d73dbc4e141d', 'request_id': 'req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:32.147791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525ec0-5f8a-4fb3-bc78-2a796ca32498 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:32.148179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525ec0-5f8a-4fb3-bc78-2a796ca32498 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:32.148687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525ec0-5f8a-4fb3-bc78-2a796ca32498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:32.173478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a7525ec0-5f8a-4fb3-bc78-2a796ca32498 None None] MFA Rules not processed for user `a5997b3965f44d6fbdf55cccdfc52ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:32.187547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a7525ec0-5f8a-4fb3-bc78-2a796ca32498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:32.312076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e33cc37cea457aa637d73dbc4e141d', 'request_id': 'req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:32.317642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 825/1648] 10.222.0.74 () {58 vars in 1057 bytes} [Mon May 23 16:45:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:45:32.321013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7525ec0-5f8a-4fb3-bc78-2a796ca32498 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:32.323920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e33cc37cea457aa637d73dbc4e141d', 'request_id': 'req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:32.335079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7525ec0-5f8a-4fb3-bc78-2a796ca32498 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:32.337848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] The token cache is being invalidate because project 74e33cc37cea457aa637d73dbc4e141d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:45:32.338272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:32.339671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e7de2c1-17cb-43bc-910a-81e3dd76cf59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:32.343447 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550995d-b6b9-450c-a8c4-614c39027b42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:32.344777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550995d-b6b9-450c-a8c4-614c39027b42 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:32.345326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550995d-b6b9-450c-a8c4-614c39027b42 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:32.345790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550995d-b6b9-450c-a8c4-614c39027b42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:32.346326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 824/1649] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:45:31 2022] DELETE /identity/v3/projects/74e33cc37cea457aa637d73dbc4e141d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:45:32.348133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a550995d-b6b9-450c-a8c4-614c39027b42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:32.348551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042bc64-9869-4121-93be-fce48782fea1 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:32.348886 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042bc64-9869-4121-93be-fce48782fea1 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:32.349221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042bc64-9869-4121-93be-fce48782fea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:32.373035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0042bc64-9869-4121-93be-fce48782fea1 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:32.374339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0042bc64-9869-4121-93be-fce48782fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:32.394463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550995d-b6b9-450c-a8c4-614c39027b42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:32.397736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550995d-b6b9-450c-a8c4-614c39027b42 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:32.423088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 826/1650] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:32.509566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 825/1651] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:32.510514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364d920-565f-4d50-8b5f-a7cc4fb79cef None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:32.510514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364d920-565f-4d50-8b5f-a7cc4fb79cef None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:32.510924 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364d920-565f-4d50-8b5f-a7cc4fb79cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:32.552022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d364d920-565f-4d50-8b5f-a7cc4fb79cef None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:32.557369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d364d920-565f-4d50-8b5f-a7cc4fb79cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:32.580801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 827/1652] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:32.584384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042bc64-9869-4121-93be-fce48782fea1 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:32.598716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042bc64-9869-4121-93be-fce48782fea1 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:32.619581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8760e-9b2b-482c-a1db-ef65a8e5598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:32.620379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8760e-9b2b-482c-a1db-ef65a8e5598b admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:32.620828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8760e-9b2b-482c-a1db-ef65a8e5598b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:32.621336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8760e-9b2b-482c-a1db-ef65a8e5598b admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:32.622082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8760e-9b2b-482c-a1db-ef65a8e5598b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:32.622386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8760e-9b2b-482c-a1db-ef65a8e5598b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:32.624036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8760e-9b2b-482c-a1db-ef65a8e5598b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:32.664453 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 826/1653] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:32.665143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364d920-565f-4d50-8b5f-a7cc4fb79cef None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:32.677982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364d920-565f-4d50-8b5f-a7cc4fb79cef None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:32.694199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194c01-123d-4a9e-bc73-3b22011606bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:32.695346 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194c01-123d-4a9e-bc73-3b22011606bd admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:32.698259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194c01-123d-4a9e-bc73-3b22011606bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:32.699081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194c01-123d-4a9e-bc73-3b22011606bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:32.703688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4194c01-123d-4a9e-bc73-3b22011606bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:32.706101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4194c01-123d-4a9e-bc73-3b22011606bd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:32.808265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 828/1654] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:32 2022] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:32.813757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8760e-9b2b-482c-a1db-ef65a8e5598b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:32.833761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8760e-9b2b-482c-a1db-ef65a8e5598b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:33.008864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb80b7-f456-45f4-8b7a-4a218401e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:33.009811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb80b7-f456-45f4-8b7a-4a218401e950 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:33.010100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb80b7-f456-45f4-8b7a-4a218401e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:33.010584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb80b7-f456-45f4-8b7a-4a218401e950 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:33.012893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb80b7-f456-45f4-8b7a-4a218401e950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:33.015437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb80b7-f456-45f4-8b7a-4a218401e950 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:33.152906 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 827/1655] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:32 2022] POST /identity/v3/users => generated 279 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:33.155463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194c01-123d-4a9e-bc73-3b22011606bd admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:33.185161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194c01-123d-4a9e-bc73-3b22011606bd admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:33.227357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf880-5da5-4c3b-af33-b4b5c947fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:33.228937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf880-5da5-4c3b-af33-b4b5c947fc41 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:33.229386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf880-5da5-4c3b-af33-b4b5c947fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:33.234351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf880-5da5-4c3b-af33-b4b5c947fc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:33.234351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf880-5da5-4c3b-af33-b4b5c947fc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:33.234351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf880-5da5-4c3b-af33-b4b5c947fc41 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:33.257446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 829/1656] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:33.262150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb80b7-f456-45f4-8b7a-4a218401e950 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:33.300401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb80b7-f456-45f4-8b7a-4a218401e950 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:33.310423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feacab-fe20-4131-9301-091bc2943655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:33.311326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feacab-fe20-4131-9301-091bc2943655 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:33.311747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feacab-fe20-4131-9301-091bc2943655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:33.312387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feacab-fe20-4131-9301-091bc2943655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:33.314610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feacab-fe20-4131-9301-091bc2943655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:33.316926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feacab-fe20-4131-9301-091bc2943655 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:33.388919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 828/1657] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:33.389429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf880-5da5-4c3b-af33-b4b5c947fc41 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:33.403150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf880-5da5-4c3b-af33-b4b5c947fc41 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:33.416406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033645c1-293d-43ad-95a6-debb4d460e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:33.417394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033645c1-293d-43ad-95a6-debb4d460e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:33.417678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033645c1-293d-43ad-95a6-debb4d460e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:33.417990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033645c1-293d-43ad-95a6-debb4d460e4b admin admin] PATH_INFO: `/v3/projects/c89a112f8cde43ee8ebcd29d89b9d720/users/a67bcb2cb6a048e1b041575da25a62b0/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:33.447821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033645c1-293d-43ad-95a6-debb4d460e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89a112f8cde43ee8ebcd29d89b9d720, user_id=a67bcb2cb6a048e1b041575da25a62b0, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:33.453194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033645c1-293d-43ad-95a6-debb4d460e4b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:33.601646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 830/1658] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:33 2022] PUT /identity/v3/projects/c89a112f8cde43ee8ebcd29d89b9d720/users/a67bcb2cb6a048e1b041575da25a62b0/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:33.614788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28d813-4f7d-4d13-bb39-bf400cf9ca3f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:33.615080 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28d813-4f7d-4d13-bb39-bf400cf9ca3f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:33.616945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28d813-4f7d-4d13-bb39-bf400cf9ca3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:33.671989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-5b28d813-4f7d-4d13-bb39-bf400cf9ca3f None None] MFA Rules not processed for user `a67bcb2cb6a048e1b041575da25a62b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:33.678857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5b28d813-4f7d-4d13-bb39-bf400cf9ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:33.885049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 829/1659] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:33 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:33.889681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033645c1-293d-43ad-95a6-debb4d460e4b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:33.998400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:34.065541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033645c1-293d-43ad-95a6-debb4d460e4b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:34.077824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e354cc-f457-4338-af81-a1d7bd4dbf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:34.078567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e354cc-f457-4338-af81-a1d7bd4dbf44 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:34.078861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e354cc-f457-4338-af81-a1d7bd4dbf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:34.079141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e354cc-f457-4338-af81-a1d7bd4dbf44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:34.079850 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e354cc-f457-4338-af81-a1d7bd4dbf44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:34.092151 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e354cc-f457-4338-af81-a1d7bd4dbf44 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:34.278307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 831/1660] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:33 2022] POST /identity/v3/projects => generated 357 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:34.279936 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28d813-4f7d-4d13-bb39-bf400cf9ca3f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:34.301204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28d813-4f7d-4d13-bb39-bf400cf9ca3f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:34.455677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c64c-82ac-4dfb-b8ee-47a87c71104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:34.456657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c64c-82ac-4dfb-b8ee-47a87c71104b admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:34.457107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c64c-82ac-4dfb-b8ee-47a87c71104b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:34.457525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c64c-82ac-4dfb-b8ee-47a87c71104b admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:34.458364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6c64c-82ac-4dfb-b8ee-47a87c71104b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:34.460511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6c64c-82ac-4dfb-b8ee-47a87c71104b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:34.522954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:34.598398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 830/1661] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:34 2022] POST /identity/v3/users => generated 285 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:34.600211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e354cc-f457-4338-af81-a1d7bd4dbf44 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:34.616342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e354cc-f457-4338-af81-a1d7bd4dbf44 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:34.631126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474daab-a062-4db6-84e1-5b1ba95a9865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:34.633005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474daab-a062-4db6-84e1-5b1ba95a9865 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:34.633418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474daab-a062-4db6-84e1-5b1ba95a9865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:34.633831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474daab-a062-4db6-84e1-5b1ba95a9865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:34.635863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474daab-a062-4db6-84e1-5b1ba95a9865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:34.638606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474daab-a062-4db6-84e1-5b1ba95a9865 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:34.664820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 832/1662] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:34.668781 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c64c-82ac-4dfb-b8ee-47a87c71104b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:34.684262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c64c-82ac-4dfb-b8ee-47a87c71104b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:34.695444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5294ed-2142-473b-b056-5b1ebf0e8932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:34.700849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5294ed-2142-473b-b056-5b1ebf0e8932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:34.701674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5294ed-2142-473b-b056-5b1ebf0e8932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:34.702095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5294ed-2142-473b-b056-5b1ebf0e8932 admin admin] PATH_INFO: `/v3/projects/9dda74a204fa43118fe7c0e1c0a6a3e6/users/9b261cce45a1460cbab76557f0b33138/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:34.768965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5294ed-2142-473b-b056-5b1ebf0e8932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dda74a204fa43118fe7c0e1c0a6a3e6, user_id=9b261cce45a1460cbab76557f0b33138, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:34.772331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5294ed-2142-473b-b056-5b1ebf0e8932 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:34.856836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 831/1663] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:34 2022] PUT /identity/v3/projects/9dda74a204fa43118fe7c0e1c0a6a3e6/users/9b261cce45a1460cbab76557f0b33138/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:34.865793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474daab-a062-4db6-84e1-5b1ba95a9865 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:34.896364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474daab-a062-4db6-84e1-5b1ba95a9865 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:35.017941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0181dc-cbae-4b0e-819f-80a9d38ec95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:35.018819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0181dc-cbae-4b0e-819f-80a9d38ec95e admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:35.019177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0181dc-cbae-4b0e-819f-80a9d38ec95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:35.020204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0181dc-cbae-4b0e-819f-80a9d38ec95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:35.025414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0181dc-cbae-4b0e-819f-80a9d38ec95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:35.028070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0181dc-cbae-4b0e-819f-80a9d38ec95e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:35.050210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 833/1664] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:35.059825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5294ed-2142-473b-b056-5b1ebf0e8932 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:35.086576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5294ed-2142-473b-b056-5b1ebf0e8932 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:35.112738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53c05-130c-4d60-88f6-ebac687ec746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:35.113975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53c05-130c-4d60-88f6-ebac687ec746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:35.114401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53c05-130c-4d60-88f6-ebac687ec746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:35.114821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53c05-130c-4d60-88f6-ebac687ec746 admin admin] PATH_INFO: `/v3/projects/9dda74a204fa43118fe7c0e1c0a6a3e6/users/9b261cce45a1460cbab76557f0b33138/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:35.118441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53c05-130c-4d60-88f6-ebac687ec746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dda74a204fa43118fe7c0e1c0a6a3e6, user_id=9b261cce45a1460cbab76557f0b33138, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:35.123836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53c05-130c-4d60-88f6-ebac687ec746 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:35.171816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 832/1665] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:35 2022] PUT /identity/v3/projects/9dda74a204fa43118fe7c0e1c0a6a3e6/users/9b261cce45a1460cbab76557f0b33138/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:35.182483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13839040-466a-4ad6-8961-ebd205c27217 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:35.183331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13839040-466a-4ad6-8961-ebd205c27217 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:35.183617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13839040-466a-4ad6-8961-ebd205c27217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:35.257740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-13839040-466a-4ad6-8961-ebd205c27217 None None] MFA Rules not processed for user `9b261cce45a1460cbab76557f0b33138`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:35.259141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-13839040-466a-4ad6-8961-ebd205c27217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:35.454525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 834/1666] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:35 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:35.467264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53c05-130c-4d60-88f6-ebac687ec746 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:35.470676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-46a53c05-130c-4d60-88f6-ebac687ec746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:35.639236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53c05-130c-4d60-88f6-ebac687ec746 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:35.654671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47820de-767d-4db9-83e0-a57636d99b70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:35.655679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47820de-767d-4db9-83e0-a57636d99b70 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:35.656218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47820de-767d-4db9-83e0-a57636d99b70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:35.656737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47820de-767d-4db9-83e0-a57636d99b70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:35.680214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47820de-767d-4db9-83e0-a57636d99b70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:35.682184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47820de-767d-4db9-83e0-a57636d99b70 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:35.724143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 833/1667] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:35 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:36.043294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13839040-466a-4ad6-8961-ebd205c27217 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:36.044716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-13839040-466a-4ad6-8961-ebd205c27217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:36.068320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13839040-466a-4ad6-8961-ebd205c27217 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:36.072215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3da4ae-c5c8-4d66-b1d7-ece55888352e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:36.072895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3da4ae-c5c8-4d66-b1d7-ece55888352e service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:36.073392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3da4ae-c5c8-4d66-b1d7-ece55888352e service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:36.073798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3da4ae-c5c8-4d66-b1d7-ece55888352e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:36.141670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:36.214898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3da4ae-c5c8-4d66-b1d7-ece55888352e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:36.217506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3da4ae-c5c8-4d66-b1d7-ece55888352e service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:36.234703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 835/1668] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:36 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:36.557548 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:38.303195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3637d2-a57a-4dc0-92a3-0a78c2913489 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:38.303952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3637d2-a57a-4dc0-92a3-0a78c2913489 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:38.303952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3637d2-a57a-4dc0-92a3-0a78c2913489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:38.336115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7c3637d2-a57a-4dc0-92a3-0a78c2913489 None None] MFA Rules not processed for user `718a82d2f4294f68965ce01aac0fc166`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:38.337446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7c3637d2-a57a-4dc0-92a3-0a78c2913489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:38.514856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 834/1669] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:38.523256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3da4ae-c5c8-4d66-b1d7-ece55888352e service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:38.524775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-cb3da4ae-c5c8-4d66-b1d7-ece55888352e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:38.710773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3da4ae-c5c8-4d66-b1d7-ece55888352e service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:38.717278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a287cc-57aa-49f3-989e-ee9ae2ba9916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:38.718066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a287cc-57aa-49f3-989e-ee9ae2ba9916 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:38.718341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a287cc-57aa-49f3-989e-ee9ae2ba9916 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:38.718610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a287cc-57aa-49f3-989e-ee9ae2ba9916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:38.728547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a287cc-57aa-49f3-989e-ee9ae2ba9916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:38.730103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a287cc-57aa-49f3-989e-ee9ae2ba9916 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:38.743433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 836/1670] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:41.956945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78098837-90ec-4c9b-8702-b414b982fdc5 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:41.974341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78098837-90ec-4c9b-8702-b414b982fdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:41.974341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78098837-90ec-4c9b-8702-b414b982fdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:42.022812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-78098837-90ec-4c9b-8702-b414b982fdc5 None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:42.028225 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-78098837-90ec-4c9b-8702-b414b982fdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:42.248223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 835/1671] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:45:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:42.703739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566beadf-b653-4c63-a044-223101c23083 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:42.704864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566beadf-b653-4c63-a044-223101c23083 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:42.705297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566beadf-b653-4c63-a044-223101c23083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:42.752453 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78098837-90ec-4c9b-8702-b414b982fdc5 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:42.754640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-78098837-90ec-4c9b-8702-b414b982fdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:42.785315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-566beadf-b653-4c63-a044-223101c23083 None None] MFA Rules not processed for user `f14f77bc65fd4ff0bc1ec6de35846f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:42.790577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-566beadf-b653-4c63-a044-223101c23083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:42.875620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78098837-90ec-4c9b-8702-b414b982fdc5 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:42.883643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a22d0e-523c-49fd-b078-711bb4f8c4cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:42.884702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22d0e-523c-49fd-b078-711bb4f8c4cb service swift] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:42.902101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22d0e-523c-49fd-b078-711bb4f8c4cb service swift] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:42.902101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22d0e-523c-49fd-b078-711bb4f8c4cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:42.904323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a22d0e-523c-49fd-b078-711bb4f8c4cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:42.906851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a22d0e-523c-49fd-b078-711bb4f8c4cb service swift] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:42.919204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 836/1672] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:45:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:45:42.984096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 837/1673] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:42.996511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379ccf-7a4b-45eb-9795-fd4a8af19a14 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:42.997495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379ccf-7a4b-45eb-9795-fd4a8af19a14 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:42.997973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379ccf-7a4b-45eb-9795-fd4a8af19a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:43.051730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-00379ccf-7a4b-45eb-9795-fd4a8af19a14 None None] MFA Rules not processed for user `f14f77bc65fd4ff0bc1ec6de35846f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:43.053316 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-00379ccf-7a4b-45eb-9795-fd4a8af19a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:43.068701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 837/1674] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:43.077314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566beadf-b653-4c63-a044-223101c23083 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:43.109324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566beadf-b653-4c63-a044-223101c23083 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:43.129123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27ce06-1d1e-4b6f-8157-91acff514578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:43.130823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27ce06-1d1e-4b6f-8157-91acff514578 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:43.131767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27ce06-1d1e-4b6f-8157-91acff514578 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:43.132439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27ce06-1d1e-4b6f-8157-91acff514578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:43.169512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27ce06-1d1e-4b6f-8157-91acff514578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:43.173863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27ce06-1d1e-4b6f-8157-91acff514578 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:43.197677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 838/1675] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:45.149589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b6b3-95fb-4ee9-8196-15f6613f3cc2 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:45.149589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b6b3-95fb-4ee9-8196-15f6613f3cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:45.149589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b6b3-95fb-4ee9-8196-15f6613f3cc2 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:45.149589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 838/1676] 10.222.0.74 () {54 vars in 912 bytes} [Mon May 23 16:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:45:45.151104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d247-d7d5-4e06-ae3b-bd0e4a25b20f None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:45.151104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d247-d7d5-4e06-ae3b-bd0e4a25b20f None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:45.151104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d247-d7d5-4e06-ae3b-bd0e4a25b20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:45.151104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c479d247-d7d5-4e06-ae3b-bd0e4a25b20f None None] MFA Rules not processed for user `a833149a66af4452aeedd5d43f2fb2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:45.153256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c479d247-d7d5-4e06-ae3b-bd0e4a25b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:45.248555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:45.324002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 839/1677] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:45:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:45.429411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64b6b3-95fb-4ee9-8196-15f6613f3cc2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:45.433113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ee64b6b3-95fb-4ee9-8196-15f6613f3cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:45.485226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64b6b3-95fb-4ee9-8196-15f6613f3cc2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:45.508864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00c584-bc7a-471b-850d-75af973db633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:45.512127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00c584-bc7a-471b-850d-75af973db633 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:45.512127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00c584-bc7a-471b-850d-75af973db633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:45.512127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00c584-bc7a-471b-850d-75af973db633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:45.530526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00c584-bc7a-471b-850d-75af973db633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:45.532605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00c584-bc7a-471b-850d-75af973db633 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:45.547033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:45.554549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 839/1678] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:45.670832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479d247-d7d5-4e06-ae3b-bd0e4a25b20f None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:45.672897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c479d247-d7d5-4e06-ae3b-bd0e4a25b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:45.950295 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479d247-d7d5-4e06-ae3b-bd0e4a25b20f None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:45.957905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e86c-85c0-4e25-b887-2fc7f9ec0867 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:45.958273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e86c-85c0-4e25-b887-2fc7f9ec0867 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:45.958778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e86c-85c0-4e25-b887-2fc7f9ec0867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:45.968002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:45.975822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:45.976117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:45.976435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] PATH_INFO: `/v3/users/a10a0e21bd094229bb111d08487875c9` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:45.990791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10a0e21bd094229bb111d08487875c9)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:45.991889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:46.025139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6e11e86c-85c0-4e25-b887-2fc7f9ec0867 None None] MFA Rules not processed for user `29e2a2fa32cd4fb7837bdec1d83cb9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:46.031765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6e11e86c-85c0-4e25-b887-2fc7f9ec0867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:46.231287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 840/1679] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:46.247878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11e86c-85c0-4e25-b887-2fc7f9ec0867 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:46.249450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6e11e86c-85c0-4e25-b887-2fc7f9ec0867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:46.282004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11e86c-85c0-4e25-b887-2fc7f9ec0867 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:46.290480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b464f1-af7e-4ef7-8e90-41de68e6dd43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:46.293222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b464f1-af7e-4ef7-8e90-41de68e6dd43 service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:46.294631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b464f1-af7e-4ef7-8e90-41de68e6dd43 service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:46.295457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b464f1-af7e-4ef7-8e90-41de68e6dd43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:46.310571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10a0e21bd094229bb111d08487875c9'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:46.318275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b464f1-af7e-4ef7-8e90-41de68e6dd43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:46.320988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b464f1-af7e-4ef7-8e90-41de68e6dd43 service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:46.341874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 841/1680] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:45:46.431289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10a0e21bd094229bb111d08487875c9'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:46.432992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10a0e21bd094229bb111d08487875c9'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:46.434319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10a0e21bd094229bb111d08487875c9'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:46.453166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10a0e21bd094229bb111d08487875c9'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:46.563511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 840/1681] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:45:45 2022] DELETE /identity/v3/users/a10a0e21bd094229bb111d08487875c9 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:46.566180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7826-1ec8-4bd9-acc6-f99fab9cd681 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:46.566469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7826-1ec8-4bd9-acc6-f99fab9cd681 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:46.569613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7826-1ec8-4bd9-acc6-f99fab9cd681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:46.620948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d70a7826-1ec8-4bd9-acc6-f99fab9cd681 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:46.623343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d70a7826-1ec8-4bd9-acc6-f99fab9cd681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:46.769005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 842/1682] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:46.873720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:46.876037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:47.122866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0888e9-4d5e-4658-88fd-98497b53fd27 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:47.128084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d292f-6325-4466-9eb6-a68d3d966020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:47.128933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d292f-6325-4466-9eb6-a68d3d966020 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:47.129782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d292f-6325-4466-9eb6-a68d3d966020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:47.130160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d292f-6325-4466-9eb6-a68d3d966020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:47.143722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d292f-6325-4466-9eb6-a68d3d966020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:47.145908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d292f-6325-4466-9eb6-a68d3d966020 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:47.167793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 841/1683] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:47.173672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5997a4-4688-4b2a-83db-0a2afb5c516a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:47.173994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5997a4-4688-4b2a-83db-0a2afb5c516a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:47.174283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5997a4-4688-4b2a-83db-0a2afb5c516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:47.257289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0c5997a4-4688-4b2a-83db-0a2afb5c516a None None] MFA Rules not processed for user `a833149a66af4452aeedd5d43f2fb2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:47.267377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0c5997a4-4688-4b2a-83db-0a2afb5c516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:47.288648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 843/1684] 10.222.0.71 () {58 vars in 1015 bytes} [Mon May 23 16:45:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:47.418422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d292f-6325-4466-9eb6-a68d3d966020 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:47.420735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ce6d292f-6325-4466-9eb6-a68d3d966020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:47.439386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:47.461402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d292f-6325-4466-9eb6-a68d3d966020 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:47.466691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328b788-f847-46f0-b227-95680e00b3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:47.467857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328b788-f847-46f0-b227-95680e00b3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:47.468210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328b788-f847-46f0-b227-95680e00b3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:47.468724 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328b788-f847-46f0-b227-95680e00b3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:47.484597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328b788-f847-46f0-b227-95680e00b3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:47.488031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328b788-f847-46f0-b227-95680e00b3ef service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:47.519215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 842/1685] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:47.611252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5997a4-4688-4b2a-83db-0a2afb5c516a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:47.612941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0c5997a4-4688-4b2a-83db-0a2afb5c516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:47.651367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5997a4-4688-4b2a-83db-0a2afb5c516a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:47.673047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:47.674058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:47.674405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:47.674802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] PATH_INFO: `/v3/users/c3854d70b6ec4c6b87f36f55f1fe0323` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:47.677894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3854d70b6ec4c6b87f36f55f1fe0323)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:47.683943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:47.941589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3854d70b6ec4c6b87f36f55f1fe0323'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:47.944477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3854d70b6ec4c6b87f36f55f1fe0323'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:47.986913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3854d70b6ec4c6b87f36f55f1fe0323'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:48.029069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:48.046172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3854d70b6ec4c6b87f36f55f1fe0323'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:48.145640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c768ea0e-5573-43db-a56c-3f7fed281a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3854d70b6ec4c6b87f36f55f1fe0323'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:48.161120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c25ac-b831-42cb-a69d-1aa102d182a6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:48.161410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c25ac-b831-42cb-a69d-1aa102d182a6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:48.161868 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c25ac-b831-42cb-a69d-1aa102d182a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:48.163662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 844/1686] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:45:47 2022] DELETE /identity/v3/users/c3854d70b6ec4c6b87f36f55f1fe0323 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:48.199986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-511c25ac-b831-42cb-a69d-1aa102d182a6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:48.213072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-511c25ac-b831-42cb-a69d-1aa102d182a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:48.288220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4c1a0-ff69-4dec-8550-ba885a8e92c0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:48.288696 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4c1a0-ff69-4dec-8550-ba885a8e92c0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:48.289047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4c1a0-ff69-4dec-8550-ba885a8e92c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:48.323505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a6a4c1a0-ff69-4dec-8550-ba885a8e92c0 None None] MFA Rules not processed for user `f14f77bc65fd4ff0bc1ec6de35846f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:48.327618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a6a4c1a0-ff69-4dec-8550-ba885a8e92c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:48.513016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 843/1687] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:48.514171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3a51e-480a-42f9-a517-e2f01559f6c6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:48.531044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3a51e-480a-42f9-a517-e2f01559f6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:48.531450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3a51e-480a-42f9-a517-e2f01559f6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:48.662560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-69b3a51e-480a-42f9-a517-e2f01559f6c6 None None] MFA Rules not processed for user `0e90497b6d9c4a789f6b31680e069087`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:48.664438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-69b3a51e-480a-42f9-a517-e2f01559f6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:48.674761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 845/1688] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:45:48.678429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4c1a0-ff69-4dec-8550-ba885a8e92c0 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:48.707775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a6a4c1a0-ff69-4dec-8550-ba885a8e92c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:48.863119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 844/1689] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:48.884875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3a51e-480a-42f9-a517-e2f01559f6c6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:48.888253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-69b3a51e-480a-42f9-a517-e2f01559f6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:48.895861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4c1a0-ff69-4dec-8550-ba885a8e92c0 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:48.915159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b22be8-52da-47a7-ad59-e3203f86244e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:48.916886 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b22be8-52da-47a7-ad59-e3203f86244e service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:48.917390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b22be8-52da-47a7-ad59-e3203f86244e service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:48.917893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b22be8-52da-47a7-ad59-e3203f86244e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:48.945755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b22be8-52da-47a7-ad59-e3203f86244e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:48.947642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b22be8-52da-47a7-ad59-e3203f86244e service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:48.968939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 846/1690] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:48.970706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf934de3-4765-4a6c-9311-5f649a425179 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:48.971164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf934de3-4765-4a6c-9311-5f649a425179 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:48.971594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf934de3-4765-4a6c-9311-5f649a425179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:49.013375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-cf934de3-4765-4a6c-9311-5f649a425179 None None] MFA Rules not processed for user `718a82d2f4294f68965ce01aac0fc166`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:49.016410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cf934de3-4765-4a6c-9311-5f649a425179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:49.116149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3a51e-480a-42f9-a517-e2f01559f6c6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:49.127629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417e12c-10b5-43d6-b3dd-e4dfbe8982fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:49.128518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417e12c-10b5-43d6-b3dd-e4dfbe8982fe service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:49.128958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417e12c-10b5-43d6-b3dd-e4dfbe8982fe service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:49.129345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417e12c-10b5-43d6-b3dd-e4dfbe8982fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:49.141216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417e12c-10b5-43d6-b3dd-e4dfbe8982fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:49.147660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417e12c-10b5-43d6-b3dd-e4dfbe8982fe service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:49.175613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 845/1691] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:45:49.196180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 847/1692] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:49.861257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417e12c-10b5-43d6-b3dd-e4dfbe8982fe service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:49.863013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3417e12c-10b5-43d6-b3dd-e4dfbe8982fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:49.887937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417e12c-10b5-43d6-b3dd-e4dfbe8982fe service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:49.895085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:49.896514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:49.897190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:49.897784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] PATH_INFO: `/v3/projects/c124de0ad7364125b9d749ec4aaf7e77` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:49.899240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c124de0ad7364125b9d749ec4aaf7e77)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:49.901811 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: WARNING py.warnings [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 16:45:49.901811 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: warnings.warn(msg) May 23 16:45:49.901811 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: May 23 16:45:49.904049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:49.907101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:50.113767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c124de0ad7364125b9d749ec4aaf7e77', 'request_id': 'req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:50.126620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c124de0ad7364125b9d749ec4aaf7e77', 'request_id': 'req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:50.221769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c124de0ad7364125b9d749ec4aaf7e77', 'request_id': 'req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:50.302827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] The token cache is being invalidate because project c124de0ad7364125b9d749ec4aaf7e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:45:50.304597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:50.311057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f7a33f33-5a8d-485f-bd8f-1bf7b9c2a667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:50.313656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 846/1693] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:45:49 2022] DELETE /identity/v3/projects/c124de0ad7364125b9d749ec4aaf7e77 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:50.318213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90fd1e-ff3a-477c-b31e-7d8e098dbcc5 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:50.318747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90fd1e-ff3a-477c-b31e-7d8e098dbcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:50.318747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90fd1e-ff3a-477c-b31e-7d8e098dbcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:50.376261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1f90fd1e-ff3a-477c-b31e-7d8e098dbcc5 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:50.381884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1f90fd1e-ff3a-477c-b31e-7d8e098dbcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:50.501340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:50.638062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 848/1694] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:50.639731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04e79-60e8-4f78-8c51-e8a78d14b061 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:50.640044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04e79-60e8-4f78-8c51-e8a78d14b061 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:50.640440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04e79-60e8-4f78-8c51-e8a78d14b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:50.723547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-74c04e79-60e8-4f78-8c51-e8a78d14b061 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:50.724857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-74c04e79-60e8-4f78-8c51-e8a78d14b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:50.779294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 847/1695] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:50.783558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90fd1e-ff3a-477c-b31e-7d8e098dbcc5 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:50.802659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90fd1e-ff3a-477c-b31e-7d8e098dbcc5 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:50.808750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e6032-5f53-4031-9e48-12eeb37dfddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:50.813342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e6032-5f53-4031-9e48-12eeb37dfddf admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:50.813885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e6032-5f53-4031-9e48-12eeb37dfddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:50.814306 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e6032-5f53-4031-9e48-12eeb37dfddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:50.815329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e6032-5f53-4031-9e48-12eeb37dfddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:50.816157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e6032-5f53-4031-9e48-12eeb37dfddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:50.822004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e6032-5f53-4031-9e48-12eeb37dfddf admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:50.860175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 849/1696] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:45:50.864674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04e79-60e8-4f78-8c51-e8a78d14b061 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:50.890636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04e79-60e8-4f78-8c51-e8a78d14b061 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:50.929301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f7ac7-c904-4c5f-b105-1bea983aed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:50.933158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f7ac7-c904-4c5f-b105-1bea983aed46 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:50.945712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f7ac7-c904-4c5f-b105-1bea983aed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:50.946485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f7ac7-c904-4c5f-b105-1bea983aed46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:50.952938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f7ac7-c904-4c5f-b105-1bea983aed46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:50.959807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f7ac7-c904-4c5f-b105-1bea983aed46 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:51.150987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 848/1697] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:50 2022] POST /identity/v3/projects => generated 373 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:51.154966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e6032-5f53-4031-9e48-12eeb37dfddf admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:51.173338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e6032-5f53-4031-9e48-12eeb37dfddf admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:51.436273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7b95f-5af3-4482-9037-43cc07317438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:51.438362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7b95f-5af3-4482-9037-43cc07317438 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:51.438654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7b95f-5af3-4482-9037-43cc07317438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:51.438935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7b95f-5af3-4482-9037-43cc07317438 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:51.439642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7b95f-5af3-4482-9037-43cc07317438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:51.441634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7b95f-5af3-4482-9037-43cc07317438 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:51.611525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 850/1698] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:51 2022] POST /identity/v3/users => generated 287 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:51.615378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f7ac7-c904-4c5f-b105-1bea983aed46 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:51.641802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f7ac7-c904-4c5f-b105-1bea983aed46 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:51.671932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af7924-1eb4-4366-b5f5-1f0feea7398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:51.675241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af7924-1eb4-4366-b5f5-1f0feea7398a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:51.675241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af7924-1eb4-4366-b5f5-1f0feea7398a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:51.675241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af7924-1eb4-4366-b5f5-1f0feea7398a admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:51.675241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af7924-1eb4-4366-b5f5-1f0feea7398a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:51.675794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af7924-1eb4-4366-b5f5-1f0feea7398a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:51.757991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 849/1699] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:45:51.760538 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7b95f-5af3-4482-9037-43cc07317438 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:51.788890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7b95f-5af3-4482-9037-43cc07317438 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:51.803658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3953ac-a6b7-4ffc-891d-eec8103098cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:51.804626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3953ac-a6b7-4ffc-891d-eec8103098cf admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:51.804994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3953ac-a6b7-4ffc-891d-eec8103098cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:51.805337 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3953ac-a6b7-4ffc-891d-eec8103098cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:51.806144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3953ac-a6b7-4ffc-891d-eec8103098cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:51.812280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3953ac-a6b7-4ffc-891d-eec8103098cf admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:51.843584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 851/1700] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:51.848003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af7924-1eb4-4366-b5f5-1f0feea7398a admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:51.895854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af7924-1eb4-4366-b5f5-1f0feea7398a admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:51.934344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d486920-02f8-4c29-ac8a-3d3b581182c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:51.937770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d486920-02f8-4c29-ac8a-3d3b581182c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:51.937770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d486920-02f8-4c29-ac8a-3d3b581182c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:51.937770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d486920-02f8-4c29-ac8a-3d3b581182c4 admin admin] PATH_INFO: `/v3/projects/4f86970ea1864762888950798cefdf76/users/fa9a032964e243b692d08331cfb682e9/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:51.977281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d486920-02f8-4c29-ac8a-3d3b581182c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f86970ea1864762888950798cefdf76, user_id=fa9a032964e243b692d08331cfb682e9, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:51.982557 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d486920-02f8-4c29-ac8a-3d3b581182c4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:52.083520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 850/1701] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:51 2022] PUT /identity/v3/projects/4f86970ea1864762888950798cefdf76/users/fa9a032964e243b692d08331cfb682e9/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:45:52.094491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75166d65-3891-449a-9a5b-f882858b252d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:52.095250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75166d65-3891-449a-9a5b-f882858b252d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:52.095915 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75166d65-3891-449a-9a5b-f882858b252d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:52.215529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-75166d65-3891-449a-9a5b-f882858b252d None None] MFA Rules not processed for user `fa9a032964e243b692d08331cfb682e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:52.219317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-75166d65-3891-449a-9a5b-f882858b252d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:52.590609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 852/1702] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:45:52.596279 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d486920-02f8-4c29-ac8a-3d3b581182c4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:52.700394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75166d65-3891-449a-9a5b-f882858b252d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:52.702018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-75166d65-3891-449a-9a5b-f882858b252d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:52.813495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:52.921693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d486920-02f8-4c29-ac8a-3d3b581182c4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:52.922419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75166d65-3891-449a-9a5b-f882858b252d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:52.941691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:52.942586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:52.942907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:52.943149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] PATH_INFO: `/v3/projects/d63172a733e14d2693542d08f148fb26` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:52.943942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b1cac-85a7-461a-b7c3-5292ebf105b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:52.945614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b1cac-85a7-461a-b7c3-5292ebf105b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:52.945908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b1cac-85a7-461a-b7c3-5292ebf105b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:52.946594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b1cac-85a7-461a-b7c3-5292ebf105b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:52.946860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63172a733e14d2693542d08f148fb26)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:52.947836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b1cac-85a7-461a-b7c3-5292ebf105b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:52.949148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:52.953176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b1cac-85a7-461a-b7c3-5292ebf105b1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:53.094453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 851/1703] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:52 2022] POST /identity/v3/projects => generated 371 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:53.098326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b1cac-85a7-461a-b7c3-5292ebf105b1 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:53.124002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63172a733e14d2693542d08f148fb26', 'request_id': 'req-fbcf958a-f2ce-44ec-a946-30591b7e553f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:53.126794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:53.244789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b1cac-85a7-461a-b7c3-5292ebf105b1 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:53.252774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63172a733e14d2693542d08f148fb26', 'request_id': 'req-fbcf958a-f2ce-44ec-a946-30591b7e553f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:53.260389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939718-3076-4e5c-8d30-e8963c1a5244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:53.262322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939718-3076-4e5c-8d30-e8963c1a5244 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:53.274179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939718-3076-4e5c-8d30-e8963c1a5244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:53.274179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939718-3076-4e5c-8d30-e8963c1a5244 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:53.274179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939718-3076-4e5c-8d30-e8963c1a5244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:53.274592 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63172a733e14d2693542d08f148fb26', 'request_id': 'req-fbcf958a-f2ce-44ec-a946-30591b7e553f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:53.275895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939718-3076-4e5c-8d30-e8963c1a5244 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:53.288766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] The token cache is being invalidate because project d63172a733e14d2693542d08f148fb26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:45:53.289165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:53.292727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:53.297585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 853/1704] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:45:52 2022] DELETE /identity/v3/projects/d63172a733e14d2693542d08f148fb26 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:45:53.298560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:53.304057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:53.482836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 852/1705] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:53 2022] POST /identity/v3/users => generated 292 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:45:53.485674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939718-3076-4e5c-8d30-e8963c1a5244 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:53.495961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-19939718-3076-4e5c-8d30-e8963c1a5244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:53.530073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf958a-f2ce-44ec-a946-30591b7e553f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:53.532495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939718-3076-4e5c-8d30-e8963c1a5244 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:53.542371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a7f85-5e28-4263-82c8-fe476e78761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:53.543402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7f85-5e28-4263-82c8-fe476e78761e admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:53.543889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7f85-5e28-4263-82c8-fe476e78761e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:53.544403 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7f85-5e28-4263-82c8-fe476e78761e admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:53.545457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a7f85-5e28-4263-82c8-fe476e78761e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:53.547790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a7f85-5e28-4263-82c8-fe476e78761e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:53.568844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:53.568844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:53.568844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:53.568844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] PATH_INFO: `/v3/users/e73034ee13914ffcaec38a8296a0e33e` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:53.569232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73034ee13914ffcaec38a8296a0e33e)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:53.571209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:53.589798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 853/1706] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:53.589798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a7f85-5e28-4263-82c8-fe476e78761e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:53.607644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a7f85-5e28-4263-82c8-fe476e78761e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:53.624234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8578db4-de40-4975-9308-a02ee4b25702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:53.624234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8578db4-de40-4975-9308-a02ee4b25702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:53.624234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8578db4-de40-4975-9308-a02ee4b25702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:53.624234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8578db4-de40-4975-9308-a02ee4b25702 admin admin] PATH_INFO: `/v3/projects/16d07d4e78694074916836a056a19ad9/users/5a7aa63d6d8845129e56513219ffa1d8/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:53.687733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8578db4-de40-4975-9308-a02ee4b25702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d07d4e78694074916836a056a19ad9, user_id=5a7aa63d6d8845129e56513219ffa1d8, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:53.700342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8578db4-de40-4975-9308-a02ee4b25702 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:53.848624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 854/1707] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:53 2022] PUT /identity/v3/projects/16d07d4e78694074916836a056a19ad9/users/5a7aa63d6d8845129e56513219ffa1d8/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:53.850073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e441357-6696-47f4-a2cc-9be1fb4ef665 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:53.850368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e441357-6696-47f4-a2cc-9be1fb4ef665 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:53.850646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e441357-6696-47f4-a2cc-9be1fb4ef665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:53.927709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73034ee13914ffcaec38a8296a0e33e'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:53.929073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73034ee13914ffcaec38a8296a0e33e'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:53.957065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-0e441357-6696-47f4-a2cc-9be1fb4ef665 None None] MFA Rules not processed for user `29e2a2fa32cd4fb7837bdec1d83cb9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:53.970323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0e441357-6696-47f4-a2cc-9be1fb4ef665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:53.978629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73034ee13914ffcaec38a8296a0e33e'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:53.999657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:54.028263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73034ee13914ffcaec38a8296a0e33e'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:54.138715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73034ee13914ffcaec38a8296a0e33e'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:54.147109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 854/1708] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:45:53 2022] DELETE /identity/v3/users/e73034ee13914ffcaec38a8296a0e33e => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:54.153431 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:54.162984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:54.311955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 855/1709] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:54.417672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae298cb-2c20-43d7-a648-a4f3ad859abc admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:54.447157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e0d86-7fb7-447f-81f5-937dd7dd29f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:54.448102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e0d86-7fb7-447f-81f5-937dd7dd29f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:54.448705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e0d86-7fb7-447f-81f5-937dd7dd29f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:54.449135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e0d86-7fb7-447f-81f5-937dd7dd29f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:54.450037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e0d86-7fb7-447f-81f5-937dd7dd29f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:54.451853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e0d86-7fb7-447f-81f5-937dd7dd29f7 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:54.483500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e441357-6696-47f4-a2cc-9be1fb4ef665 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:54.484290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 855/1710] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:54.817282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e441357-6696-47f4-a2cc-9be1fb4ef665 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:54.836499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224584-b681-46ac-bd74-6bc8d50aa54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:54.841891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224584-b681-46ac-bd74-6bc8d50aa54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:54.842186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224584-b681-46ac-bd74-6bc8d50aa54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:54.842465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224584-b681-46ac-bd74-6bc8d50aa54f admin admin] PATH_INFO: `/v3/projects/16d07d4e78694074916836a056a19ad9/users/5a7aa63d6d8845129e56513219ffa1d8/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:54.850676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224584-b681-46ac-bd74-6bc8d50aa54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d07d4e78694074916836a056a19ad9, user_id=5a7aa63d6d8845129e56513219ffa1d8, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:54.865338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224584-b681-46ac-bd74-6bc8d50aa54f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:54.932796 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 856/1711] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:54 2022] PUT /identity/v3/projects/16d07d4e78694074916836a056a19ad9/users/5a7aa63d6d8845129e56513219ffa1d8/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:45:54.934682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8745a-b128-47e3-ba73-d392807daf54 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:54.936325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8745a-b128-47e3-ba73-d392807daf54 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:54.936798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8745a-b128-47e3-ba73-d392807daf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:55.091320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6ccb-1a02-4660-ae01-313397094953 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:55.091859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6ccb-1a02-4660-ae01-313397094953 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:55.092015 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6ccb-1a02-4660-ae01-313397094953 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:55.095240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 857/1712] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 16:45:55.096941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d0e8745a-b128-47e3-ba73-d392807daf54 None None] MFA Rules not processed for user `5a7aa63d6d8845129e56513219ffa1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:55.098420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d0e8745a-b128-47e3-ba73-d392807daf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:55.115718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f708b1-e8d4-4a6b-808a-2a7e1763e804 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:55.115718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f708b1-e8d4-4a6b-808a-2a7e1763e804 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:55.116843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f708b1-e8d4-4a6b-808a-2a7e1763e804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:55.172444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b6f708b1-e8d4-4a6b-808a-2a7e1763e804 None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:55.178199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b6f708b1-e8d4-4a6b-808a-2a7e1763e804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:55.289430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 856/1713] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:45:55.334214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8745a-b128-47e3-ba73-d392807daf54 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:55.338562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d0e8745a-b128-47e3-ba73-d392807daf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:55.541910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:55.692340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8745a-b128-47e3-ba73-d392807daf54 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:55.711709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64625486-1f78-450f-b6c0-6879b2500934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:55.713961 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64625486-1f78-450f-b6c0-6879b2500934 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:55.715230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64625486-1f78-450f-b6c0-6879b2500934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:55.716733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64625486-1f78-450f-b6c0-6879b2500934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:55.733470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 858/1714] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:45:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 619 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:55.756854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64625486-1f78-450f-b6c0-6879b2500934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:55.761738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64625486-1f78-450f-b6c0-6879b2500934 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:55.803068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 857/1715] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:55.896444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f708b1-e8d4-4a6b-808a-2a7e1763e804 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:55.898475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b6f708b1-e8d4-4a6b-808a-2a7e1763e804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:55.932973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f708b1-e8d4-4a6b-808a-2a7e1763e804 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:55.945739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af32142-949b-431d-814e-0156ae97ef8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:55.955727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af32142-949b-431d-814e-0156ae97ef8d service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:55.956031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af32142-949b-431d-814e-0156ae97ef8d service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:55.956406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af32142-949b-431d-814e-0156ae97ef8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:55.981983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af32142-949b-431d-814e-0156ae97ef8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:55.983650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af32142-949b-431d-814e-0156ae97ef8d service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:56.003026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 859/1716] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:45:56.035247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64625486-1f78-450f-b6c0-6879b2500934 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:56.040228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-64625486-1f78-450f-b6c0-6879b2500934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:56.061844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:56.324428 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64625486-1f78-450f-b6c0-6879b2500934 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:56.357475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:56.358600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:56.359018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:56.359529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] PATH_INFO: `/v3/projects/4fadd641738c4f7d80b91ee48768c0b4` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:56.361536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fadd641738c4f7d80b91ee48768c0b4)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:56.366090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:56.735732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fadd641738c4f7d80b91ee48768c0b4', 'request_id': 'req-49318813-da0c-40fd-98d7-bbe84ca34958'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:56.921823 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fadd641738c4f7d80b91ee48768c0b4', 'request_id': 'req-49318813-da0c-40fd-98d7-bbe84ca34958'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:56.933470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fadd641738c4f7d80b91ee48768c0b4', 'request_id': 'req-49318813-da0c-40fd-98d7-bbe84ca34958'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:56.961539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] The token cache is being invalidate because project 4fadd641738c4f7d80b91ee48768c0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:45:56.970265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:56.970265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-49318813-da0c-40fd-98d7-bbe84ca34958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:56.970265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 858/1717] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:45:56 2022] DELETE /identity/v3/projects/4fadd641738c4f7d80b91ee48768c0b4 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:56.973060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55617d2-d987-4437-b7b6-15a3f768599c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:56.973586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55617d2-d987-4437-b7b6-15a3f768599c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:56.973900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55617d2-d987-4437-b7b6-15a3f768599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:57.041411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b55617d2-d987-4437-b7b6-15a3f768599c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:57.048114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b55617d2-d987-4437-b7b6-15a3f768599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:57.305269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 860/1718] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:57.313601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1190f-2695-451f-94c2-eb9f429d9355 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:57.314658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1190f-2695-451f-94c2-eb9f429d9355 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:57.315096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1190f-2695-451f-94c2-eb9f429d9355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:57.339017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-3ae1190f-2695-451f-94c2-eb9f429d9355 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:57.340532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3ae1190f-2695-451f-94c2-eb9f429d9355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:57.356860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55617d2-d987-4437-b7b6-15a3f768599c None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:57.366218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 859/1719] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:57.371885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55617d2-d987-4437-b7b6-15a3f768599c None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:57.378386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efefb9-4c30-4e65-b98f-4c72cc24d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:57.379670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efefb9-4c30-4e65-b98f-4c72cc24d79b admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:57.380082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efefb9-4c30-4e65-b98f-4c72cc24d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:57.380543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efefb9-4c30-4e65-b98f-4c72cc24d79b admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:57.381482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efefb9-4c30-4e65-b98f-4c72cc24d79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:45:57.381926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efefb9-4c30-4e65-b98f-4c72cc24d79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:57.383792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efefb9-4c30-4e65-b98f-4c72cc24d79b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:57.406686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1190f-2695-451f-94c2-eb9f429d9355 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:57.419740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1190f-2695-451f-94c2-eb9f429d9355 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:57.420680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 861/1720] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:45:57.425804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7aeda-1985-431a-8947-38fa977fa3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:57.426864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7aeda-1985-431a-8947-38fa977fa3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:57.430964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7aeda-1985-431a-8947-38fa977fa3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:57.432028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7aeda-1985-431a-8947-38fa977fa3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:57.433195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7aeda-1985-431a-8947-38fa977fa3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:57.435416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7aeda-1985-431a-8947-38fa977fa3b9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:57.624727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 860/1721] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:57 2022] POST /identity/v3/projects => generated 363 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:45:57.625544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efefb9-4c30-4e65-b98f-4c72cc24d79b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:57.639090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efefb9-4c30-4e65-b98f-4c72cc24d79b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:57.685280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7aeda-1985-431a-8947-38fa977fa3b9 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:57.687480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5ff7aeda-1985-431a-8947-38fa977fa3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:57.803075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f7535-0fd4-4a38-9819-fc632797d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:57.826616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f7535-0fd4-4a38-9819-fc632797d4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:57.830099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f7535-0fd4-4a38-9819-fc632797d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:57.830556 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f7535-0fd4-4a38-9819-fc632797d4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:57.831516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f7535-0fd4-4a38-9819-fc632797d4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:57.834539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f7535-0fd4-4a38-9819-fc632797d4d1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:57.898664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7aeda-1985-431a-8947-38fa977fa3b9 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:57.925443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:57.927888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:57.930510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:57.932164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:57.932164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] PATH_INFO: `/v3/users/fa9a032964e243b692d08331cfb682e9` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:57.934982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa9a032964e243b692d08331cfb682e9)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:57.943026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 862/1722] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:57 2022] POST /identity/v3/users => generated 282 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:57.943485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:57.945129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f7535-0fd4-4a38-9819-fc632797d4d1 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:58.018644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f7535-0fd4-4a38-9819-fc632797d4d1 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:58.043634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845279c-6d19-4be8-9e22-49ecb5eb690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:58.047127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845279c-6d19-4be8-9e22-49ecb5eb690e admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:58.059097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845279c-6d19-4be8-9e22-49ecb5eb690e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:58.059761 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845279c-6d19-4be8-9e22-49ecb5eb690e admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:58.064976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845279c-6d19-4be8-9e22-49ecb5eb690e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:58.070067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845279c-6d19-4be8-9e22-49ecb5eb690e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:58.132114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 863/1723] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:58.135417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845279c-6d19-4be8-9e22-49ecb5eb690e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:58.171299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845279c-6d19-4be8-9e22-49ecb5eb690e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:58.200137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ed5ea-ed82-4c21-8288-7137759abde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:58.205239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ed5ea-ed82-4c21-8288-7137759abde2 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:58.206759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ed5ea-ed82-4c21-8288-7137759abde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:58.207216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ed5ea-ed82-4c21-8288-7137759abde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:58.208126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ed5ea-ed82-4c21-8288-7137759abde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:58.212375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ed5ea-ed82-4c21-8288-7137759abde2 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:58.256133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 864/1724] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:45:58.259219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ed5ea-ed82-4c21-8288-7137759abde2 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:58.284437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ed5ea-ed82-4c21-8288-7137759abde2 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:58.313043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e56cd0-fb91-4b9e-b6d4-49b9b2f208c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:58.314937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e56cd0-fb91-4b9e-b6d4-49b9b2f208c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:58.320674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e56cd0-fb91-4b9e-b6d4-49b9b2f208c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:58.322227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e56cd0-fb91-4b9e-b6d4-49b9b2f208c7 admin admin] PATH_INFO: `/v3/projects/a26c7761ecb44bd4946d7bf15fc6e0a8/users/12be8e87b72c49e8b8f6e0a6cc60d7ea/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:58.362758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa9a032964e243b692d08331cfb682e9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:58.363976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa9a032964e243b692d08331cfb682e9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:58.388984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e56cd0-fb91-4b9e-b6d4-49b9b2f208c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26c7761ecb44bd4946d7bf15fc6e0a8, user_id=12be8e87b72c49e8b8f6e0a6cc60d7ea, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:58.390839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa9a032964e243b692d08331cfb682e9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:58.396153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e56cd0-fb91-4b9e-b6d4-49b9b2f208c7 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:58.441174 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa9a032964e243b692d08331cfb682e9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:58.556023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-88fc3f8e-5c2f-46ff-9ac2-dfab18ebbc4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa9a032964e243b692d08331cfb682e9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:45:58.563904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 865/1725] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:45:58 2022] PUT /identity/v3/projects/a26c7761ecb44bd4946d7bf15fc6e0a8/users/12be8e87b72c49e8b8f6e0a6cc60d7ea/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:58.570569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 861/1726] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:45:57 2022] DELETE /identity/v3/users/fa9a032964e243b692d08331cfb682e9 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:45:58.581640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc75b3-de0c-46f9-bd73-fc39d248e61b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:58.581640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc75b3-de0c-46f9-bd73-fc39d248e61b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:58.581640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc75b3-de0c-46f9-bd73-fc39d248e61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:58.585135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820518cd-9bad-46fd-b298-d3257bc6fddf None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:58.592675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820518cd-9bad-46fd-b298-d3257bc6fddf None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:58.593191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820518cd-9bad-46fd-b298-d3257bc6fddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:58.659681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-fdfc75b3-de0c-46f9-bd73-fc39d248e61b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:58.661001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-fdfc75b3-de0c-46f9-bd73-fc39d248e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:58.701565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-820518cd-9bad-46fd-b298-d3257bc6fddf None None] MFA Rules not processed for user `12be8e87b72c49e8b8f6e0a6cc60d7ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:45:58.709219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-820518cd-9bad-46fd-b298-d3257bc6fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:58.889247 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 866/1727] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:58.961980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc75b3-de0c-46f9-bd73-fc39d248e61b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:58.965008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-fdfc75b3-de0c-46f9-bd73-fc39d248e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:58.975616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 862/1728] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:45:58.976574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820518cd-9bad-46fd-b298-d3257bc6fddf None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:58.978646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-820518cd-9bad-46fd-b298-d3257bc6fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:45:59.023872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820518cd-9bad-46fd-b298-d3257bc6fddf None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:59.064252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0aaa2-da12-4442-a3da-f1664d2cc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:59.065081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0aaa2-da12-4442-a3da-f1664d2cc117 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:59.065482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0aaa2-da12-4442-a3da-f1664d2cc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:59.065848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0aaa2-da12-4442-a3da-f1664d2cc117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:59.066646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0aaa2-da12-4442-a3da-f1664d2cc117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:59.068875 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0aaa2-da12-4442-a3da-f1664d2cc117 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:59.117561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc75b3-de0c-46f9-bd73-fc39d248e61b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:59.122375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784312e-5cfe-4dc0-a83a-0e408e0ab8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:59.123336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784312e-5cfe-4dc0-a83a-0e408e0ab8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:59.123809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784312e-5cfe-4dc0-a83a-0e408e0ab8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:59.124319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784312e-5cfe-4dc0-a83a-0e408e0ab8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:59.139701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784312e-5cfe-4dc0-a83a-0e408e0ab8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:59.141744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784312e-5cfe-4dc0-a83a-0e408e0ab8e9 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:45:59.154032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 867/1729] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:45:59.198813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 863/1730] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:45:58 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:45:59.202841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784312e-5cfe-4dc0-a83a-0e408e0ab8e9 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:45:59.223482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784312e-5cfe-4dc0-a83a-0e408e0ab8e9 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:45:59.350727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:59.502050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a36c3b-2359-4fd0-838d-6a004ff14c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:45:59.502050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a36c3b-2359-4fd0-838d-6a004ff14c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:45:59.502050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a36c3b-2359-4fd0-838d-6a004ff14c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:45:59.502050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a36c3b-2359-4fd0-838d-6a004ff14c8e admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:45:59.502951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a36c3b-2359-4fd0-838d-6a004ff14c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:45:59.502951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a36c3b-2359-4fd0-838d-6a004ff14c8e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:00.030639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 868/1731] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:45:59 2022] POST /identity/v3/users => generated 289 bytes in 826 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:00.031950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0aaa2-da12-4442-a3da-f1664d2cc117 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:00.052378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0aaa2-da12-4442-a3da-f1664d2cc117 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:00.066402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c72b3-1dde-4e45-a645-edb55b63983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:00.067177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c72b3-1dde-4e45-a645-edb55b63983c admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:00.067540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c72b3-1dde-4e45-a645-edb55b63983c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:00.067881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c72b3-1dde-4e45-a645-edb55b63983c admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:00.068725 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c72b3-1dde-4e45-a645-edb55b63983c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:00.070547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c72b3-1dde-4e45-a645-edb55b63983c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:00.127128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 864/1732] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:00.132447 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a36c3b-2359-4fd0-838d-6a004ff14c8e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:00.145731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a36c3b-2359-4fd0-838d-6a004ff14c8e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:00.158773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd2a6d-0fce-4f2b-8ccf-2b53cfdc3570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:00.160362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd2a6d-0fce-4f2b-8ccf-2b53cfdc3570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:00.160839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd2a6d-0fce-4f2b-8ccf-2b53cfdc3570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:00.161271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd2a6d-0fce-4f2b-8ccf-2b53cfdc3570 admin admin] PATH_INFO: `/v3/projects/d1e307f50df647f0ab034c6dd163d7fc/users/0746b32237d64652906655bab90aad02/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:00.205828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd2a6d-0fce-4f2b-8ccf-2b53cfdc3570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e307f50df647f0ab034c6dd163d7fc, user_id=0746b32237d64652906655bab90aad02, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:00.208906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd2a6d-0fce-4f2b-8ccf-2b53cfdc3570 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:00.326810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 869/1733] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:00 2022] PUT /identity/v3/projects/d1e307f50df647f0ab034c6dd163d7fc/users/0746b32237d64652906655bab90aad02/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:00.328287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c72b3-1dde-4e45-a645-edb55b63983c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:00.343924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c72b3-1dde-4e45-a645-edb55b63983c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:00.500250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a2dda-f3f3-44e6-9914-56584f68322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:00.501848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a2dda-f3f3-44e6-9914-56584f68322d admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:00.502825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a2dda-f3f3-44e6-9914-56584f68322d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:00.503921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a2dda-f3f3-44e6-9914-56584f68322d admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:00.504888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a2dda-f3f3-44e6-9914-56584f68322d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:00.507740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a2dda-f3f3-44e6-9914-56584f68322d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:00.527803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 865/1734] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:00.533006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd2a6d-0fce-4f2b-8ccf-2b53cfdc3570 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:00.551250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd2a6d-0fce-4f2b-8ccf-2b53cfdc3570 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:00.567417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b4d88-8d72-41f5-ba00-2a46ea54f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:00.568778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b4d88-8d72-41f5-ba00-2a46ea54f3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:00.569225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b4d88-8d72-41f5-ba00-2a46ea54f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:00.570044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b4d88-8d72-41f5-ba00-2a46ea54f3cd admin admin] PATH_INFO: `/v3/projects/d1e307f50df647f0ab034c6dd163d7fc/users/0746b32237d64652906655bab90aad02/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:00.580968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b4d88-8d72-41f5-ba00-2a46ea54f3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e307f50df647f0ab034c6dd163d7fc, user_id=0746b32237d64652906655bab90aad02, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:00.586763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b4d88-8d72-41f5-ba00-2a46ea54f3cd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:00.615251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 870/1735] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:00 2022] PUT /identity/v3/projects/d1e307f50df647f0ab034c6dd163d7fc/users/0746b32237d64652906655bab90aad02/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:00.631546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e74be-66bb-44ac-9067-d24774d0bcb0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:00.631991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e74be-66bb-44ac-9067-d24774d0bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:00.632562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e74be-66bb-44ac-9067-d24774d0bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:00.690838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a49e74be-66bb-44ac-9067-d24774d0bcb0 None None] MFA Rules not processed for user `0746b32237d64652906655bab90aad02`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:00.692466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a49e74be-66bb-44ac-9067-d24774d0bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:00.793196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 866/1736] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:00.808912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b4d88-8d72-41f5-ba00-2a46ea54f3cd admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:00.811463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7f0b4d88-8d72-41f5-ba00-2a46ea54f3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:00.887219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cddcbc-1d50-4c23-acc9-57b6d4b80cc9 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:00.887671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cddcbc-1d50-4c23-acc9-57b6d4b80cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:00.888027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cddcbc-1d50-4c23-acc9-57b6d4b80cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:00.922228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b4cddcbc-1d50-4c23-acc9-57b6d4b80cc9 None None] MFA Rules not processed for user `0e90497b6d9c4a789f6b31680e069087`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:00.929176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b4cddcbc-1d50-4c23-acc9-57b6d4b80cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:00.940841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b4d88-8d72-41f5-ba00-2a46ea54f3cd admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:00.949308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55b56-3316-44c8-926c-c27f48dcaaf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:00.950943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55b56-3316-44c8-926c-c27f48dcaaf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:00.950943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55b56-3316-44c8-926c-c27f48dcaaf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:00.950943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55b56-3316-44c8-926c-c27f48dcaaf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:00.974350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55b56-3316-44c8-926c-c27f48dcaaf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:00.975819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55b56-3316-44c8-926c-c27f48dcaaf5 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:00.995263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 871/1737] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:01.053613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 867/1738] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:01.172928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:01.280910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55b56-3316-44c8-926c-c27f48dcaaf5 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:01.294976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55b56-3316-44c8-926c-c27f48dcaaf5 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:01.321687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e1df-8205-4f43-adb9-bfc453e61681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:01.324005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e1df-8205-4f43-adb9-bfc453e61681 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:01.324126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e1df-8205-4f43-adb9-bfc453e61681 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:01.324502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e1df-8205-4f43-adb9-bfc453e61681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:01.370767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cddcbc-1d50-4c23-acc9-57b6d4b80cc9 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:01.374402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b4cddcbc-1d50-4c23-acc9-57b6d4b80cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:01.465505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4e1df-8205-4f43-adb9-bfc453e61681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:01.467188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4e1df-8205-4f43-adb9-bfc453e61681 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:01.478279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cddcbc-1d50-4c23-acc9-57b6d4b80cc9 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:01.480408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 872/1739] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:01.506995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:01.510350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:01.510896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:01.512884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] PATH_INFO: `/v3/projects/4f86970ea1864762888950798cefdf76` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:01.519171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f86970ea1864762888950798cefdf76)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:01.526534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:01.732845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f86970ea1864762888950798cefdf76', 'request_id': 'req-ecfddfa8-3b95-4192-b438-ff3f99664767'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:01.832285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f86970ea1864762888950798cefdf76', 'request_id': 'req-ecfddfa8-3b95-4192-b438-ff3f99664767'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:01.842159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f86970ea1864762888950798cefdf76', 'request_id': 'req-ecfddfa8-3b95-4192-b438-ff3f99664767'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:01.860682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] The token cache is being invalidate because project 4f86970ea1864762888950798cefdf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:01.866735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:01.866735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:01.867971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 868/1740] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:01 2022] DELETE /identity/v3/projects/4f86970ea1864762888950798cefdf76 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:01.872857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e1df-8205-4f43-adb9-bfc453e61681 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:01.890295 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e1df-8205-4f43-adb9-bfc453e61681 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:02.188774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:02.189673 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:02.189957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:02.190233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] PATH_INFO: `/v3/users/5a7aa63d6d8845129e56513219ffa1d8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:02.192251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7aa63d6d8845129e56513219ffa1d8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:02.200516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:02.505664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7aa63d6d8845129e56513219ffa1d8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:02.595787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7aa63d6d8845129e56513219ffa1d8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:02.597069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7aa63d6d8845129e56513219ffa1d8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:02.598071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7aa63d6d8845129e56513219ffa1d8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:02.616935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dfa0421c-0e0f-4238-b21f-56db9c5463d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7aa63d6d8845129e56513219ffa1d8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:02.657147 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 873/1741] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:01 2022] DELETE /identity/v3/users/5a7aa63d6d8845129e56513219ffa1d8 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:03.270929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:03.373019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:03.630355 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:03.632513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:03.657002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfddfa8-3b95-4192-b438-ff3f99664767 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:03.758182 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:03.759880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:03.761805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:03.762317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] PATH_INFO: `/v3/projects/16d07d4e78694074916836a056a19ad9` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:03.763907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d07d4e78694074916836a056a19ad9)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:03.766487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:03.954552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d07d4e78694074916836a056a19ad9', 'request_id': 'req-0a19eadc-db6e-4146-9a19-4559bae8726b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:04.061850 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eeb0e-6a85-4dca-ae92-77d5f0dd395f None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.062242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eeb0e-6a85-4dca-ae92-77d5f0dd395f None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.062526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eeb0e-6a85-4dca-ae92-77d5f0dd395f None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.064008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 874/1742] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:46:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:46:04.070420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d07d4e78694074916836a056a19ad9', 'request_id': 'req-0a19eadc-db6e-4146-9a19-4559bae8726b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:04.080916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7bed1-bd89-4b26-bcd7-0a2fe6310446 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.081753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7bed1-bd89-4b26-bcd7-0a2fe6310446 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.082240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7bed1-bd89-4b26-bcd7-0a2fe6310446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.085518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d07d4e78694074916836a056a19ad9', 'request_id': 'req-0a19eadc-db6e-4146-9a19-4559bae8726b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:04.108489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] The token cache is being invalidate because project 16d07d4e78694074916836a056a19ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:04.108803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:04.109837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0a19eadc-db6e-4146-9a19-4559bae8726b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:04.111461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 869/1743] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:03 2022] DELETE /identity/v3/projects/16d07d4e78694074916836a056a19ad9 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:04.124045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d597dd-4913-4363-a14b-d11ccbf5bcb0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.124720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-78e7bed1-bd89-4b26-bcd7-0a2fe6310446 None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:04.132265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d597dd-4913-4363-a14b-d11ccbf5bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.132265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d597dd-4913-4363-a14b-d11ccbf5bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.132699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-78e7bed1-bd89-4b26-bcd7-0a2fe6310446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:04.164516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-e3d597dd-4913-4363-a14b-d11ccbf5bcb0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:04.166769 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e3d597dd-4913-4363-a14b-d11ccbf5bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:04.246926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 875/1744] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:46:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:04.266345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7bed1-bd89-4b26-bcd7-0a2fe6310446 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:04.268159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-78e7bed1-bd89-4b26-bcd7-0a2fe6310446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:04.296363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7bed1-bd89-4b26-bcd7-0a2fe6310446 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:04.308646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 870/1745] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:04.311464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0ca32-88c9-4222-b29e-640a6ea86f04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:04.312248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ca32-88c9-4222-b29e-640a6ea86f04 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.312853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ca32-88c9-4222-b29e-640a6ea86f04 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.313269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ca32-88c9-4222-b29e-640a6ea86f04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.327564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0ca32-88c9-4222-b29e-640a6ea86f04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:04.329355 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8f3a-63b9-4594-9359-3b969eb200c0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.329869 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8f3a-63b9-4594-9359-3b969eb200c0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.330240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0ca32-88c9-4222-b29e-640a6ea86f04 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:04.330352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8f3a-63b9-4594-9359-3b969eb200c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.351019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 876/1746] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:04.376606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8f2e8f3a-63b9-4594-9359-3b969eb200c0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:04.381396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8f2e8f3a-63b9-4594-9359-3b969eb200c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:04.402642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 871/1747] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:04.407051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0ca32-88c9-4222-b29e-640a6ea86f04 service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:04.423748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0ca32-88c9-4222-b29e-640a6ea86f04 service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:04.433753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cfb4c-3131-419e-92ac-5206f9a0a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:04.434445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cfb4c-3131-419e-92ac-5206f9a0a586 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.434727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cfb4c-3131-419e-92ac-5206f9a0a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.435554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cfb4c-3131-419e-92ac-5206f9a0a586 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.437130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cfb4c-3131-419e-92ac-5206f9a0a586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:04.437591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cfb4c-3131-419e-92ac-5206f9a0a586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:04.440287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cfb4c-3131-419e-92ac-5206f9a0a586 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:04.469731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 877/1748] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:46:04.471482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8f3a-63b9-4594-9359-3b969eb200c0 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:04.493871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8f3a-63b9-4594-9359-3b969eb200c0 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:04.512997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7eb52-9f00-45fd-8b34-6070ad30e4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:04.513682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7eb52-9f00-45fd-8b34-6070ad30e4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.513964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7eb52-9f00-45fd-8b34-6070ad30e4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.514238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7eb52-9f00-45fd-8b34-6070ad30e4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.514939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7eb52-9f00-45fd-8b34-6070ad30e4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:04.517917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7eb52-9f00-45fd-8b34-6070ad30e4ee admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:04.689132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 872/1749] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:04 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:04.693426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cfb4c-3131-419e-92ac-5206f9a0a586 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:04.704513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cfb4c-3131-419e-92ac-5206f9a0a586 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:04.766886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c2051-f189-46de-b7f9-f0fb0e0b8e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:04.767568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c2051-f189-46de-b7f9-f0fb0e0b8e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.767860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c2051-f189-46de-b7f9-f0fb0e0b8e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.768188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c2051-f189-46de-b7f9-f0fb0e0b8e2f admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.768985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c2051-f189-46de-b7f9-f0fb0e0b8e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:04.770931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c2051-f189-46de-b7f9-f0fb0e0b8e2f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:04.879280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 878/1750] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:04 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:04.880497 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7eb52-9f00-45fd-8b34-6070ad30e4ee admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:04.892579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7eb52-9f00-45fd-8b34-6070ad30e4ee admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:04.930660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb795139-e005-496a-a477-d630f25d8d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:04.930660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb795139-e005-496a-a477-d630f25d8d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.930660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb795139-e005-496a-a477-d630f25d8d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.930660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb795139-e005-496a-a477-d630f25d8d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.932061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb795139-e005-496a-a477-d630f25d8d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:04.932061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb795139-e005-496a-a477-d630f25d8d39 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:04.935849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 873/1751] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:04.940899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c2051-f189-46de-b7f9-f0fb0e0b8e2f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:04.957581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c2051-f189-46de-b7f9-f0fb0e0b8e2f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:04.966198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619df31-4c24-4025-b6f8-94789ad0a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:04.967650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619df31-4c24-4025-b6f8-94789ad0a389 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:04.968182 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619df31-4c24-4025-b6f8-94789ad0a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:04.968778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619df31-4c24-4025-b6f8-94789ad0a389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:04.970495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619df31-4c24-4025-b6f8-94789ad0a389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:04.973080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619df31-4c24-4025-b6f8-94789ad0a389 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:04.987022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 879/1752] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:04.991266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb795139-e005-496a-a477-d630f25d8d39 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:05.004098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb795139-e005-496a-a477-d630f25d8d39 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:05.011037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efb5c1-affe-4b5f-8a66-394d7ec6dc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:05.012355 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efb5c1-affe-4b5f-8a66-394d7ec6dc07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:05.012890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efb5c1-affe-4b5f-8a66-394d7ec6dc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:05.013374 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efb5c1-affe-4b5f-8a66-394d7ec6dc07 admin admin] PATH_INFO: `/v3/projects/c5e4f508a2f0483888412d995d2df9e1/users/29dd618cb49043cdb246bd911d0418a1/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:05.045808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efb5c1-affe-4b5f-8a66-394d7ec6dc07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e4f508a2f0483888412d995d2df9e1, user_id=29dd618cb49043cdb246bd911d0418a1, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:05.049021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efb5c1-affe-4b5f-8a66-394d7ec6dc07 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:06.116155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 874/1753] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:04 2022] PUT /identity/v3/projects/c5e4f508a2f0483888412d995d2df9e1/users/29dd618cb49043cdb246bd911d0418a1/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 1125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:06.134696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4b38-e543-43c5-9526-ddfc9feb43ba None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:06.135242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4b38-e543-43c5-9526-ddfc9feb43ba None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:06.135242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4b38-e543-43c5-9526-ddfc9feb43ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:06.186844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a7ba4b38-e543-43c5-9526-ddfc9feb43ba None None] MFA Rules not processed for user `29dd618cb49043cdb246bd911d0418a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:06.188440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a7ba4b38-e543-43c5-9526-ddfc9feb43ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:06.289395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 880/1754] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:06.294322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efb5c1-affe-4b5f-8a66-394d7ec6dc07 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:06.390093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efb5c1-affe-4b5f-8a66-394d7ec6dc07 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:06.395519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094665-a188-4890-a930-09857789915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:06.396420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094665-a188-4890-a930-09857789915f admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:06.396990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094665-a188-4890-a930-09857789915f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:06.397471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094665-a188-4890-a930-09857789915f admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:06.398619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee094665-a188-4890-a930-09857789915f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:06.402241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee094665-a188-4890-a930-09857789915f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:06.404797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:06.594399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 875/1755] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:06 2022] POST /identity/v3/projects => generated 389 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:06.596281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba4b38-e543-43c5-9526-ddfc9feb43ba None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:06.609394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba4b38-e543-43c5-9526-ddfc9feb43ba None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:06.659186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094665-a188-4890-a930-09857789915f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:06.660991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ee094665-a188-4890-a930-09857789915f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:06.694559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59c745-7eaa-443b-827c-9f8a029b2085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:06.695901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59c745-7eaa-443b-827c-9f8a029b2085 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:06.696438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59c745-7eaa-443b-827c-9f8a029b2085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:06.696874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59c745-7eaa-443b-827c-9f8a029b2085 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:06.700732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59c745-7eaa-443b-827c-9f8a029b2085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:06.700732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59c745-7eaa-443b-827c-9f8a029b2085 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:06.746884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094665-a188-4890-a930-09857789915f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:06.753410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:06.755488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:06.755774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:06.756080 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] PATH_INFO: `/v3/users/a67bcb2cb6a048e1b041575da25a62b0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:06.757434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67bcb2cb6a048e1b041575da25a62b0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:06.764278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:06.806467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 881/1756] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:06 2022] POST /identity/v3/users => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:06.810467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59c745-7eaa-443b-827c-9f8a029b2085 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:06.822385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59c745-7eaa-443b-827c-9f8a029b2085 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:06.833960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364c879-c1ab-48bb-a97e-0d1458d154e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:06.852116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364c879-c1ab-48bb-a97e-0d1458d154e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:06.852116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364c879-c1ab-48bb-a97e-0d1458d154e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:06.852116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364c879-c1ab-48bb-a97e-0d1458d154e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:06.852116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364c879-c1ab-48bb-a97e-0d1458d154e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:06.852116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364c879-c1ab-48bb-a97e-0d1458d154e1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:06.865523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 882/1757] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:06.866461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364c879-c1ab-48bb-a97e-0d1458d154e1 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:06.878980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364c879-c1ab-48bb-a97e-0d1458d154e1 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:06.888503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2e53-0fd4-41fe-852d-9d053cf984f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:06.889598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2e53-0fd4-41fe-852d-9d053cf984f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:06.889881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2e53-0fd4-41fe-852d-9d053cf984f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:06.890160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2e53-0fd4-41fe-852d-9d053cf984f1 admin admin] PATH_INFO: `/v3/projects/cc1357effd4c47c3a386cb4c9bbc53bd/users/c8080fc16bd6473b9f37fcba1f9d1775/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:06.928798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c2e53-0fd4-41fe-852d-9d053cf984f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1357effd4c47c3a386cb4c9bbc53bd, user_id=c8080fc16bd6473b9f37fcba1f9d1775, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:06.933079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c2e53-0fd4-41fe-852d-9d053cf984f1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:07.178921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 883/1758] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:06 2022] PUT /identity/v3/projects/cc1357effd4c47c3a386cb4c9bbc53bd/users/c8080fc16bd6473b9f37fcba1f9d1775/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:07.183948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2e53-0fd4-41fe-852d-9d053cf984f1 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:07.187727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67bcb2cb6a048e1b041575da25a62b0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:07.188801 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67bcb2cb6a048e1b041575da25a62b0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:07.199207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67bcb2cb6a048e1b041575da25a62b0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:07.231938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67bcb2cb6a048e1b041575da25a62b0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:07.270078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2e53-0fd4-41fe-852d-9d053cf984f1 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:07.275100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d278c90-98ed-4ca7-809c-50752bff2411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:07.275876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d278c90-98ed-4ca7-809c-50752bff2411 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:07.276281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d278c90-98ed-4ca7-809c-50752bff2411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:07.276679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d278c90-98ed-4ca7-809c-50752bff2411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:07.277503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d278c90-98ed-4ca7-809c-50752bff2411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:07.279220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d278c90-98ed-4ca7-809c-50752bff2411 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:07.291201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 884/1759] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:07.295342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d278c90-98ed-4ca7-809c-50752bff2411 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:07.310653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d278c90-98ed-4ca7-809c-50752bff2411 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:07.326584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c67b-ab1d-4f27-ab20-dbdce15cabf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:07.326584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c67b-ab1d-4f27-ab20-dbdce15cabf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:07.326584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c67b-ab1d-4f27-ab20-dbdce15cabf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:07.326584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c67b-ab1d-4f27-ab20-dbdce15cabf2 admin admin] PATH_INFO: `/v3/projects/cc1357effd4c47c3a386cb4c9bbc53bd/users/c8080fc16bd6473b9f37fcba1f9d1775/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:07.327403 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c67b-ab1d-4f27-ab20-dbdce15cabf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1357effd4c47c3a386cb4c9bbc53bd, user_id=c8080fc16bd6473b9f37fcba1f9d1775, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:07.330587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c67b-ab1d-4f27-ab20-dbdce15cabf2 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:07.341221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 885/1760] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:07 2022] PUT /identity/v3/projects/cc1357effd4c47c3a386cb4c9bbc53bd/users/c8080fc16bd6473b9f37fcba1f9d1775/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:07.353160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50bc87-301c-4a06-9463-2581f9ba4fee None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:07.353728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50bc87-301c-4a06-9463-2581f9ba4fee None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:07.353912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50bc87-301c-4a06-9463-2581f9ba4fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:07.355480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d9e1baff-401a-4474-bdee-59a5591517d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67bcb2cb6a048e1b041575da25a62b0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:07.362963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 876/1761] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:06 2022] DELETE /identity/v3/users/a67bcb2cb6a048e1b041575da25a62b0 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:07.371416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d813-64e5-46df-ac26-ad48672fd5b6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:07.371796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d813-64e5-46df-ac26-ad48672fd5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:07.372082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d813-64e5-46df-ac26-ad48672fd5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:07.384918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5f50bc87-301c-4a06-9463-2581f9ba4fee None None] MFA Rules not processed for user `c8080fc16bd6473b9f37fcba1f9d1775`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:07.386139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5f50bc87-301c-4a06-9463-2581f9ba4fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:07.399857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a251d813-64e5-46df-ac26-ad48672fd5b6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:07.401351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a251d813-64e5-46df-ac26-ad48672fd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:07.473551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 877/1762] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:07.479659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 886/1763] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:07.481759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251d813-64e5-46df-ac26-ad48672fd5b6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:07.485294 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a251d813-64e5-46df-ac26-ad48672fd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:07.501036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50bc87-301c-4a06-9463-2581f9ba4fee None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:07.502893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5f50bc87-301c-4a06-9463-2581f9ba4fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:07.548453 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251d813-64e5-46df-ac26-ad48672fd5b6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:07.552311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701800-b6e6-481c-a05c-546c064f2add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:07.552985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701800-b6e6-481c-a05c-546c064f2add service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:07.553274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701800-b6e6-481c-a05c-546c064f2add service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:07.553715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701800-b6e6-481c-a05c-546c064f2add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:07.563565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:07.566051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd701800-b6e6-481c-a05c-546c064f2add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:07.573076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd701800-b6e6-481c-a05c-546c064f2add service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:07.573189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50bc87-301c-4a06-9463-2581f9ba4fee None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:07.576502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38a370-751d-484f-ac0d-47060de289b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:07.577191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38a370-751d-484f-ac0d-47060de289b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:07.577547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38a370-751d-484f-ac0d-47060de289b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:07.578763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38a370-751d-484f-ac0d-47060de289b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:07.578887 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 878/1764] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:07.588779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38a370-751d-484f-ac0d-47060de289b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:07.590304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38a370-751d-484f-ac0d-47060de289b1 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:07.601146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 887/1765] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:07.742548 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701800-b6e6-481c-a05c-546c064f2add service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:07.744099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cd701800-b6e6-481c-a05c-546c064f2add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:07.756870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701800-b6e6-481c-a05c-546c064f2add service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:07.767938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:07.767938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:07.767938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:07.767938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] PATH_INFO: `/v3/users/29dd618cb49043cdb246bd911d0418a1` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:07.768257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29dd618cb49043cdb246bd911d0418a1)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:07.768257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:08.010093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29dd618cb49043cdb246bd911d0418a1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.010844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29dd618cb49043cdb246bd911d0418a1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.018080 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29dd618cb49043cdb246bd911d0418a1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.030327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29dd618cb49043cdb246bd911d0418a1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.077137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38a370-751d-484f-ac0d-47060de289b1 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:08.078956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3b38a370-751d-484f-ac0d-47060de289b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:08.103730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38a370-751d-484f-ac0d-47060de289b1 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:08.103997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-367a9030-4097-4cd9-a854-f0b49dcbd257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29dd618cb49043cdb246bd911d0418a1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.116460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:08.116667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:08.117063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:08.117358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] PATH_INFO: `/v3/projects/c89a112f8cde43ee8ebcd29d89b9d720` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:08.118456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 879/1766] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:07 2022] DELETE /identity/v3/users/29dd618cb49043cdb246bd911d0418a1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:08.121466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89a112f8cde43ee8ebcd29d89b9d720)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:08.121466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:08.123442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479297db-d055-40b2-a8c2-a40fbfda1083 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:08.123818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479297db-d055-40b2-a8c2-a40fbfda1083 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:08.124357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479297db-d055-40b2-a8c2-a40fbfda1083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:08.149016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-479297db-d055-40b2-a8c2-a40fbfda1083 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:08.150954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-479297db-d055-40b2-a8c2-a40fbfda1083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:08.250456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 880/1767] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:08.262947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479297db-d055-40b2-a8c2-a40fbfda1083 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:08.265236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-479297db-d055-40b2-a8c2-a40fbfda1083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:08.343960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:08.356880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89a112f8cde43ee8ebcd29d89b9d720', 'request_id': 'req-57cf1061-d2f7-4def-bd64-4fd0709e877a'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.360901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479297db-d055-40b2-a8c2-a40fbfda1083 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:08.364518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89a112f8cde43ee8ebcd29d89b9d720', 'request_id': 'req-57cf1061-d2f7-4def-bd64-4fd0709e877a'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.416575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf03f3-5c9d-4f88-94a6-3f2a2b1773e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:08.417348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf03f3-5c9d-4f88-94a6-3f2a2b1773e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:08.417635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf03f3-5c9d-4f88-94a6-3f2a2b1773e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:08.417910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf03f3-5c9d-4f88-94a6-3f2a2b1773e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:08.459052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89a112f8cde43ee8ebcd29d89b9d720', 'request_id': 'req-57cf1061-d2f7-4def-bd64-4fd0709e877a'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.472085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] The token cache is being invalidate because project c89a112f8cde43ee8ebcd29d89b9d720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:08.472940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.473668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:08.475265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 888/1768] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:08 2022] DELETE /identity/v3/projects/c89a112f8cde43ee8ebcd29d89b9d720 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:08.481232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:08.483289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:08.504393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf03f3-5c9d-4f88-94a6-3f2a2b1773e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:08.506564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf03f3-5c9d-4f88-94a6-3f2a2b1773e8 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:08.518611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 881/1769] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:08.556461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf1061-d2f7-4def-bd64-4fd0709e877a admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:08.561383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:08.562304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:08.562764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:08.562901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] PATH_INFO: `/v3/users/9b261cce45a1460cbab76557f0b33138` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:08.564404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b261cce45a1460cbab76557f0b33138)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:08.566353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:08.862478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b261cce45a1460cbab76557f0b33138'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.097691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b261cce45a1460cbab76557f0b33138'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.098305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b261cce45a1460cbab76557f0b33138'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.098935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b261cce45a1460cbab76557f0b33138'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.107020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b261cce45a1460cbab76557f0b33138'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.124957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 889/1770] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:08 2022] DELETE /identity/v3/users/9b261cce45a1460cbab76557f0b33138 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:09.222008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf03f3-5c9d-4f88-94a6-3f2a2b1773e8 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:09.223568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cbdf03f3-5c9d-4f88-94a6-3f2a2b1773e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:09.235873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:09.240047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf03f3-5c9d-4f88-94a6-3f2a2b1773e8 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:09.450229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:09.453541 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:09.458186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:09.458186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] PATH_INFO: `/v3/projects/c5e4f508a2f0483888412d995d2df9e1` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:09.458186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e4f508a2f0483888412d995d2df9e1)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:09.459128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:09.623990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e4f508a2f0483888412d995d2df9e1', 'request_id': 'req-c80293af-37d0-4b54-9c7c-baf2aa646e31'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.746003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:09.747476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:09.768998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dde432-2aa6-4117-b36b-73152a8ecc38 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:09.790199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e4f508a2f0483888412d995d2df9e1', 'request_id': 'req-c80293af-37d0-4b54-9c7c-baf2aa646e31'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.798369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e4f508a2f0483888412d995d2df9e1', 'request_id': 'req-c80293af-37d0-4b54-9c7c-baf2aa646e31'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.819666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] The token cache is being invalidate because project c5e4f508a2f0483888412d995d2df9e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:09.820169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.821937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:09.824561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 882/1771] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:09 2022] DELETE /identity/v3/projects/c5e4f508a2f0483888412d995d2df9e1 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:09.829450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:09.830832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:09.851903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:09.853268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:09.853985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:09.853985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] PATH_INFO: `/v3/projects/9dda74a204fa43118fe7c0e1c0a6a3e6` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:09.855560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dda74a204fa43118fe7c0e1c0a6a3e6)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:09.857779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:09.901148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80293af-37d0-4b54-9c7c-baf2aa646e31 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:09.905885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:09.906815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:09.907169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:09.907658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] PATH_INFO: `/v3/users/c8080fc16bd6473b9f37fcba1f9d1775` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:09.908968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8080fc16bd6473b9f37fcba1f9d1775)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:09.917832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:10.075513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dda74a204fa43118fe7c0e1c0a6a3e6', 'request_id': 'req-8874965d-b910-42e5-8ffe-8b7d74d7d207'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.081695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dda74a204fa43118fe7c0e1c0a6a3e6', 'request_id': 'req-8874965d-b910-42e5-8ffe-8b7d74d7d207'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.206543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dda74a204fa43118fe7c0e1c0a6a3e6', 'request_id': 'req-8874965d-b910-42e5-8ffe-8b7d74d7d207'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.219606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] The token cache is being invalidate because project 9dda74a204fa43118fe7c0e1c0a6a3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:10.219963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.220650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8874965d-b910-42e5-8ffe-8b7d74d7d207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.222535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 890/1772] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:09 2022] DELETE /identity/v3/projects/9dda74a204fa43118fe7c0e1c0a6a3e6 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:10.223641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec019e1-1f4a-4854-8ec7-f1196b90cb21 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.223934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec019e1-1f4a-4854-8ec7-f1196b90cb21 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.224216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec019e1-1f4a-4854-8ec7-f1196b90cb21 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.225906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 891/1773] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:46:10.226854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f23713-3609-4a80-975d-bd744437b868 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.227770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f23713-3609-4a80-975d-bd744437b868 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.227974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f23713-3609-4a80-975d-bd744437b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.233568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8080fc16bd6473b9f37fcba1f9d1775'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.234357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8080fc16bd6473b9f37fcba1f9d1775'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.241538 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8080fc16bd6473b9f37fcba1f9d1775'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.247512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d3f23713-3609-4a80-975d-bd744437b868 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:10.248773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d3f23713-3609-4a80-975d-bd744437b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:10.253848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8080fc16bd6473b9f37fcba1f9d1775'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.308896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 892/1774] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:10.310195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b74c9-0b4c-49c5-968e-4d8a14f9c194 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.310492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b74c9-0b4c-49c5-968e-4d8a14f9c194 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.310775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b74c9-0b4c-49c5-968e-4d8a14f9c194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.326169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4f15f110-246a-478e-803a-d28e26f45c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8080fc16bd6473b9f37fcba1f9d1775'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:10.328843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-471b74c9-0b4c-49c5-968e-4d8a14f9c194 None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:10.330061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-471b74c9-0b4c-49c5-968e-4d8a14f9c194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:10.333318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 883/1775] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:09 2022] DELETE /identity/v3/users/c8080fc16bd6473b9f37fcba1f9d1775 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:10.334749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f471e-7e98-4b63-9f8e-ec67e88edb2e None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.340753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f471e-7e98-4b63-9f8e-ec67e88edb2e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.340753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f471e-7e98-4b63-9f8e-ec67e88edb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.354296 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0c3f471e-7e98-4b63-9f8e-ec67e88edb2e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:10.359675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0c3f471e-7e98-4b63-9f8e-ec67e88edb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:10.405473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 893/1776] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:46:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:10.419179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b74c9-0b4c-49c5-968e-4d8a14f9c194 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:10.420777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-471b74c9-0b4c-49c5-968e-4d8a14f9c194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:10.422256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 884/1777] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:10.426421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f471e-7e98-4b63-9f8e-ec67e88edb2e None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:10.436210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f471e-7e98-4b63-9f8e-ec67e88edb2e None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:10.440934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b74c9-0b4c-49c5-968e-4d8a14f9c194 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:10.441686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b89ca-ee64-496d-b182-21edb05ee16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:10.442366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b89ca-ee64-496d-b182-21edb05ee16b admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.442651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b89ca-ee64-496d-b182-21edb05ee16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.443005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b89ca-ee64-496d-b182-21edb05ee16b admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.443657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b89ca-ee64-496d-b182-21edb05ee16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:10.443970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b89ca-ee64-496d-b182-21edb05ee16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:10.445697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b89ca-ee64-496d-b182-21edb05ee16b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:10.458364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 885/1778] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:46:10.463011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b89ca-ee64-496d-b182-21edb05ee16b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:10.473007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b89ca-ee64-496d-b182-21edb05ee16b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:10.480588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ace0-0cdb-42b3-8f14-571309a1c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:10.481330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ace0-0cdb-42b3-8f14-571309a1c381 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.481688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ace0-0cdb-42b3-8f14-571309a1c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.482057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ace0-0cdb-42b3-8f14-571309a1c381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.482898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90ace0-0cdb-42b3-8f14-571309a1c381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:10.485156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90ace0-0cdb-42b3-8f14-571309a1c381 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:10.508190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58567397-ccd4-45cb-b8b1-fcc4f530a139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:10.509419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567397-ccd4-45cb-b8b1-fcc4f530a139 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.509781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567397-ccd4-45cb-b8b1-fcc4f530a139 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.510099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567397-ccd4-45cb-b8b1-fcc4f530a139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.520400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58567397-ccd4-45cb-b8b1-fcc4f530a139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:10.522173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58567397-ccd4-45cb-b8b1-fcc4f530a139 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:10.535847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 894/1779] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:10.600559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 886/1780] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:10 2022] POST /identity/v3/projects => generated 393 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:10.602573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58567397-ccd4-45cb-b8b1-fcc4f530a139 service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:10.618955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58567397-ccd4-45cb-b8b1-fcc4f530a139 service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:10.690045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befecf59-b1ce-42a7-a8e1-15e420073728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:10.690805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befecf59-b1ce-42a7-a8e1-15e420073728 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.696286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befecf59-b1ce-42a7-a8e1-15e420073728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.696286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befecf59-b1ce-42a7-a8e1-15e420073728 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.696286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befecf59-b1ce-42a7-a8e1-15e420073728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:10.696286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befecf59-b1ce-42a7-a8e1-15e420073728 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:10.699117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:10.778309 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:10.785327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 895/1781] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:10 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:10.792019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ace0-0cdb-42b3-8f14-571309a1c381 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:10.811679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ace0-0cdb-42b3-8f14-571309a1c381 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:10.812350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befecf59-b1ce-42a7-a8e1-15e420073728 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:10.822985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-befecf59-b1ce-42a7-a8e1-15e420073728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:10.830415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb99be-a56f-4ec9-83a5-ea73e3ccace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:10.831046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb99be-a56f-4ec9-83a5-ea73e3ccace2 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.831721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb99be-a56f-4ec9-83a5-ea73e3ccace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.832140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb99be-a56f-4ec9-83a5-ea73e3ccace2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.833353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb99be-a56f-4ec9-83a5-ea73e3ccace2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:10.835201 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb99be-a56f-4ec9-83a5-ea73e3ccace2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:10.854607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befecf59-b1ce-42a7-a8e1-15e420073728 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:10.854973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 887/1782] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:10.855067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:10.855826 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb99be-a56f-4ec9-83a5-ea73e3ccace2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:10.855943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.856275 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.856717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] PATH_INFO: `/v3/projects/cc1357effd4c47c3a386cb4c9bbc53bd` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.858068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1357effd4c47c3a386cb4c9bbc53bd)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:10.860149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:10.868048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb99be-a56f-4ec9-83a5-ea73e3ccace2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:10.875082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d8dd9-9415-4c01-a659-3859ddef581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:10.875929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d8dd9-9415-4c01-a659-3859ddef581a admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.876764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d8dd9-9415-4c01-a659-3859ddef581a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.876764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d8dd9-9415-4c01-a659-3859ddef581a admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.877253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d8dd9-9415-4c01-a659-3859ddef581a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:10.879241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d8dd9-9415-4c01-a659-3859ddef581a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:10.892401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 888/1783] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:10.896422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d8dd9-9415-4c01-a659-3859ddef581a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:10.908803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d8dd9-9415-4c01-a659-3859ddef581a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:10.913701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a0a3-1ed9-4de4-8b44-e09d0deebd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:10.920278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a0a3-1ed9-4de4-8b44-e09d0deebd3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:10.920278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a0a3-1ed9-4de4-8b44-e09d0deebd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:10.920278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a0a3-1ed9-4de4-8b44-e09d0deebd3a admin admin] PATH_INFO: `/v3/projects/68e3f35852c7401bae3337a4c80474d4/users/f46dbb3de17f440ba8da2ebb2516bf19/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:10.932386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529a0a3-1ed9-4de4-8b44-e09d0deebd3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e3f35852c7401bae3337a4c80474d4, user_id=f46dbb3de17f440ba8da2ebb2516bf19, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:10.935444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529a0a3-1ed9-4de4-8b44-e09d0deebd3a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.058734 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 889/1784] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:10 2022] PUT /identity/v3/projects/68e3f35852c7401bae3337a4c80474d4/users/f46dbb3de17f440ba8da2ebb2516bf19/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:11.067181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1357effd4c47c3a386cb4c9bbc53bd', 'request_id': 'req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:11.071770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1357effd4c47c3a386cb4c9bbc53bd', 'request_id': 'req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:11.076893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a492f79-d252-42ca-930c-3e00280f6158 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.077188 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a492f79-d252-42ca-930c-3e00280f6158 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.077470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a492f79-d252-42ca-930c-3e00280f6158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.103937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9a492f79-d252-42ca-930c-3e00280f6158 None None] MFA Rules not processed for user `f46dbb3de17f440ba8da2ebb2516bf19`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:11.105177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9a492f79-d252-42ca-930c-3e00280f6158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:11.166941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 890/1785] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:11.171307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a492f79-d252-42ca-930c-3e00280f6158 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.217608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1357effd4c47c3a386cb4c9bbc53bd', 'request_id': 'req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:11.233396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] The token cache is being invalidate because project cc1357effd4c47c3a386cb4c9bbc53bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:11.233690 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:11.234388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbbd0e08-8b85-4b96-a1a5-0c3db77c386c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:11.234939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a492f79-d252-42ca-930c-3e00280f6158 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.236123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 896/1786] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:10 2022] DELETE /identity/v3/projects/cc1357effd4c47c3a386cb4c9bbc53bd => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:11.241025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6aa3-1c85-4cf0-bb90-2cb3addcb61a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.241319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6aa3-1c85-4cf0-bb90-2cb3addcb61a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.241590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6aa3-1c85-4cf0-bb90-2cb3addcb61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.243565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceadf79-be2c-435c-b213-dce6cd2f84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.244236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceadf79-be2c-435c-b213-dce6cd2f84be admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.244558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceadf79-be2c-435c-b213-dce6cd2f84be admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.244895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceadf79-be2c-435c-b213-dce6cd2f84be admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.245590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceadf79-be2c-435c-b213-dce6cd2f84be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.247543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceadf79-be2c-435c-b213-dce6cd2f84be admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.259956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c80a6aa3-1c85-4cf0-bb90-2cb3addcb61a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:11.261185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c80a6aa3-1c85-4cf0-bb90-2cb3addcb61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:11.269363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 897/1787] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:11.281756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f14779-7c3a-4649-810b-9f1d4df3b15b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.282049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f14779-7c3a-4649-810b-9f1d4df3b15b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.282381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f14779-7c3a-4649-810b-9f1d4df3b15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.300516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-21f14779-7c3a-4649-810b-9f1d4df3b15b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:11.301710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-21f14779-7c3a-4649-810b-9f1d4df3b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:11.309546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 898/1788] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:11.313492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f14779-7c3a-4649-810b-9f1d4df3b15b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.322597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f14779-7c3a-4649-810b-9f1d4df3b15b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.327136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a72696-4313-417d-ae9d-afbfa63028a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.327754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a72696-4313-417d-ae9d-afbfa63028a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.328321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a72696-4313-417d-ae9d-afbfa63028a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.328609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a72696-4313-417d-ae9d-afbfa63028a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.329314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a72696-4313-417d-ae9d-afbfa63028a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:11.329620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a72696-4313-417d-ae9d-afbfa63028a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.331238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a72696-4313-417d-ae9d-afbfa63028a6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.340813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 891/1789] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:11 2022] POST /identity/v3/projects => generated 393 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:11.347483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 899/1790] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:46:11.350246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceadf79-be2c-435c-b213-dce6cd2f84be admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.350630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a72696-4313-417d-ae9d-afbfa63028a6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.351914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3ceadf79-be2c-435c-b213-dce6cd2f84be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:11.360603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a72696-4313-417d-ae9d-afbfa63028a6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.416760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceadf79-be2c-435c-b213-dce6cd2f84be admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.420578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21562c-5f60-480d-8856-80f19118a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.421243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21562c-5f60-480d-8856-80f19118a56c admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.421378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141ae7d-19e1-4075-a850-3f5b71ffe207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.421526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21562c-5f60-480d-8856-80f19118a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.421803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21562c-5f60-480d-8856-80f19118a56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.421972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141ae7d-19e1-4075-a850-3f5b71ffe207 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.422258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141ae7d-19e1-4075-a850-3f5b71ffe207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.422543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141ae7d-19e1-4075-a850-3f5b71ffe207 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.422651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21562c-5f60-480d-8856-80f19118a56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.423236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141ae7d-19e1-4075-a850-3f5b71ffe207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.424496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21562c-5f60-480d-8856-80f19118a56c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.425211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141ae7d-19e1-4075-a850-3f5b71ffe207 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.515284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 892/1791] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:11 2022] POST /identity/v3/users => generated 303 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:11.519090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141ae7d-19e1-4075-a850-3f5b71ffe207 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.528518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141ae7d-19e1-4075-a850-3f5b71ffe207 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.533911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ac35e-404f-435c-b66b-10144978f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.534559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ac35e-404f-435c-b66b-10144978f33c admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.534840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ac35e-404f-435c-b66b-10144978f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.535111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ac35e-404f-435c-b66b-10144978f33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.535822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ac35e-404f-435c-b66b-10144978f33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.537477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ac35e-404f-435c-b66b-10144978f33c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.540475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 900/1792] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:11 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:11.546242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21562c-5f60-480d-8856-80f19118a56c admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.550561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 893/1793] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:11.551470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ac35e-404f-435c-b66b-10144978f33c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.562909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ac35e-404f-435c-b66b-10144978f33c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.620744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21562c-5f60-480d-8856-80f19118a56c admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.626535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2b5e-5471-4d48-8d93-d9916d9efae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.627313 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2b5e-5471-4d48-8d93-d9916d9efae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.627748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2b5e-5471-4d48-8d93-d9916d9efae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.628128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2b5e-5471-4d48-8d93-d9916d9efae5 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.629028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f2b5e-5471-4d48-8d93-d9916d9efae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.631121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f2b5e-5471-4d48-8d93-d9916d9efae5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.634407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc06a-5555-45da-b677-e252bf8ac49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.635319 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc06a-5555-45da-b677-e252bf8ac49d admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.635852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc06a-5555-45da-b677-e252bf8ac49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.635994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc06a-5555-45da-b677-e252bf8ac49d admin admin] PATH_INFO: `/v3/projects/62c849c90b7548ed97d7a100b1da1a6f/users/f301410590d54c76b20986af33aaa745/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.652829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc06a-5555-45da-b677-e252bf8ac49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c849c90b7548ed97d7a100b1da1a6f, user_id=f301410590d54c76b20986af33aaa745, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.655538 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc06a-5555-45da-b677-e252bf8ac49d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.738569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 901/1794] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:11 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:11.747852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2b5e-5471-4d48-8d93-d9916d9efae5 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.757460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2b5e-5471-4d48-8d93-d9916d9efae5 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.762193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838d61f-293e-49c7-aa46-1ff4ec19499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.762836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838d61f-293e-49c7-aa46-1ff4ec19499b admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.763123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838d61f-293e-49c7-aa46-1ff4ec19499b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.763404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838d61f-293e-49c7-aa46-1ff4ec19499b admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.764122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838d61f-293e-49c7-aa46-1ff4ec19499b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.765853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838d61f-293e-49c7-aa46-1ff4ec19499b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.772113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 894/1795] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:11 2022] PUT /identity/v3/projects/62c849c90b7548ed97d7a100b1da1a6f/users/f301410590d54c76b20986af33aaa745/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:11.776090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc06a-5555-45da-b677-e252bf8ac49d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.779372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 902/1796] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:11.781978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838d61f-293e-49c7-aa46-1ff4ec19499b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.799424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838d61f-293e-49c7-aa46-1ff4ec19499b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.855480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc06a-5555-45da-b677-e252bf8ac49d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.857256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2bd4-65f6-410e-83ba-ed90b923c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.857941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2bd4-65f6-410e-83ba-ed90b923c8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.858231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2bd4-65f6-410e-83ba-ed90b923c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.858511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2bd4-65f6-410e-83ba-ed90b923c8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.859246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2bd4-65f6-410e-83ba-ed90b923c8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.860758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51640-6dd6-452b-9960-e49a5798ea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.860882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2bd4-65f6-410e-83ba-ed90b923c8e0 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.861444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51640-6dd6-452b-9960-e49a5798ea90 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.861772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51640-6dd6-452b-9960-e49a5798ea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.862115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51640-6dd6-452b-9960-e49a5798ea90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.863073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd51640-6dd6-452b-9960-e49a5798ea90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.864719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd51640-6dd6-452b-9960-e49a5798ea90 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.881455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 903/1797] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:11.881874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 895/1798] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:11.882645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2bd4-65f6-410e-83ba-ed90b923c8e0 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.882834 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51640-6dd6-452b-9960-e49a5798ea90 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:11.892712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2bd4-65f6-410e-83ba-ed90b923c8e0 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.893262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51640-6dd6-452b-9960-e49a5798ea90 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:11.897759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3147af-7b90-4dc3-9a5f-f2a355d3bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.898734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3147af-7b90-4dc3-9a5f-f2a355d3bc25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.898907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002110e0-4c05-45c0-b9cc-8daaa84e1af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:11.899215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3147af-7b90-4dc3-9a5f-f2a355d3bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.899562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3147af-7b90-4dc3-9a5f-f2a355d3bc25 admin admin] PATH_INFO: `/v3/projects/62c849c90b7548ed97d7a100b1da1a6f/users/f301410590d54c76b20986af33aaa745/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.899800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002110e0-4c05-45c0-b9cc-8daaa84e1af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.900081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002110e0-4c05-45c0-b9cc-8daaa84e1af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.900404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002110e0-4c05-45c0-b9cc-8daaa84e1af8 admin admin] PATH_INFO: `/v3/projects/3c1edb9f6c514927866c6cef8905142a/users/116d0a9a7df341c2a133fe9df1e1c636/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.902128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3147af-7b90-4dc3-9a5f-f2a355d3bc25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c849c90b7548ed97d7a100b1da1a6f, user_id=f301410590d54c76b20986af33aaa745, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.905274 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3147af-7b90-4dc3-9a5f-f2a355d3bc25 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.909163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:11.918251 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002110e0-4c05-45c0-b9cc-8daaa84e1af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1edb9f6c514927866c6cef8905142a, user_id=116d0a9a7df341c2a133fe9df1e1c636, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:11.931352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002110e0-4c05-45c0-b9cc-8daaa84e1af8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:11.931535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 904/1799] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:11 2022] PUT /identity/v3/projects/62c849c90b7548ed97d7a100b1da1a6f/users/f301410590d54c76b20986af33aaa745/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:11.933439 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192945c-818a-49b3-ac4d-0c50939c5239 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:11.933826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192945c-818a-49b3-ac4d-0c50939c5239 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:11.934295 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192945c-818a-49b3-ac4d-0c50939c5239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:11.967234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a192945c-818a-49b3-ac4d-0c50939c5239 None None] MFA Rules not processed for user `f301410590d54c76b20986af33aaa745`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:11.968810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a192945c-818a-49b3-ac4d-0c50939c5239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:12.000363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 896/1800] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:11 2022] PUT /identity/v3/projects/3c1edb9f6c514927866c6cef8905142a/users/116d0a9a7df341c2a133fe9df1e1c636/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:12.001814 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:12.004584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f3d7e-699b-4bcf-8dc5-3dfbe17dd71e None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:12.005154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f3d7e-699b-4bcf-8dc5-3dfbe17dd71e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:12.005626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f3d7e-699b-4bcf-8dc5-3dfbe17dd71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:12.038717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d94f3d7e-699b-4bcf-8dc5-3dfbe17dd71e None None] MFA Rules not processed for user `116d0a9a7df341c2a133fe9df1e1c636`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:12.041307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d94f3d7e-699b-4bcf-8dc5-3dfbe17dd71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:12.097163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 905/1801] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:12.111909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192945c-818a-49b3-ac4d-0c50939c5239 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:12.113565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a192945c-818a-49b3-ac4d-0c50939c5239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:12.188450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192945c-818a-49b3-ac4d-0c50939c5239 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:12.206138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 897/1802] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:12.211134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f3d7e-699b-4bcf-8dc5-3dfbe17dd71e None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:12.278089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4ffdd-78a3-4d0d-ba19-a986412773c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:12.278089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4ffdd-78a3-4d0d-ba19-a986412773c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:12.278089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4ffdd-78a3-4d0d-ba19-a986412773c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:12.278089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4ffdd-78a3-4d0d-ba19-a986412773c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:12.291577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f3d7e-699b-4bcf-8dc5-3dfbe17dd71e None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:12.296415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98882d-1e14-4dc5-b9c7-30042fd46118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:12.297212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98882d-1e14-4dc5-b9c7-30042fd46118 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:12.297671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98882d-1e14-4dc5-b9c7-30042fd46118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:12.298001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98882d-1e14-4dc5-b9c7-30042fd46118 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:12.305807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98882d-1e14-4dc5-b9c7-30042fd46118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:12.305807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98882d-1e14-4dc5-b9c7-30042fd46118 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:12.345498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4ffdd-78a3-4d0d-ba19-a986412773c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:12.346947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4ffdd-78a3-4d0d-ba19-a986412773c1 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:12.356835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 906/1803] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:12.406755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4ffdd-78a3-4d0d-ba19-a986412773c1 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:12.408150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4ab4ffdd-78a3-4d0d-ba19-a986412773c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:12.419108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4ffdd-78a3-4d0d-ba19-a986412773c1 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:12.422757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dc6e3-7d90-43ca-8d77-1df440a95928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:12.423402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dc6e3-7d90-43ca-8d77-1df440a95928 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:12.423682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dc6e3-7d90-43ca-8d77-1df440a95928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:12.423956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dc6e3-7d90-43ca-8d77-1df440a95928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:12.425858 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-780dc6e3-7d90-43ca-8d77-1df440a95928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:12.455490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 898/1804] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:12 2022] POST /identity/v3/projects => generated 383 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:12.459689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98882d-1e14-4dc5-b9c7-30042fd46118 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:12.499169 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dc6e3-7d90-43ca-8d77-1df440a95928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:12.500654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dc6e3-7d90-43ca-8d77-1df440a95928 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:12.510180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 907/1805] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:12.552489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98882d-1e14-4dc5-b9c7-30042fd46118 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:12.558269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e106-70fa-45ed-a1cd-db641e09af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:12.560668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e106-70fa-45ed-a1cd-db641e09af9b admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:12.560668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e106-70fa-45ed-a1cd-db641e09af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:12.560668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e106-70fa-45ed-a1cd-db641e09af9b admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:12.560668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829e106-70fa-45ed-a1cd-db641e09af9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:12.562135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829e106-70fa-45ed-a1cd-db641e09af9b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:12.676408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 899/1806] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:12 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:12.676915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dc6e3-7d90-43ca-8d77-1df440a95928 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:12.689143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dc6e3-7d90-43ca-8d77-1df440a95928 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:12.693872 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc1a8c-a4de-4bf5-9429-32b38ad3c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:12.694543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc1a8c-a4de-4bf5-9429-32b38ad3c1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:12.694829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc1a8c-a4de-4bf5-9429-32b38ad3c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:12.695106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc1a8c-a4de-4bf5-9429-32b38ad3c1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:12.696082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc1a8c-a4de-4bf5-9429-32b38ad3c1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:12.697634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc1a8c-a4de-4bf5-9429-32b38ad3c1d0 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:12.715054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 908/1807] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:12.717851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e106-70fa-45ed-a1cd-db641e09af9b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:12.728371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e106-70fa-45ed-a1cd-db641e09af9b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:12.733322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f595c-2848-4842-a702-06cd3e889d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:12.734204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f595c-2848-4842-a702-06cd3e889d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:12.734487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f595c-2848-4842-a702-06cd3e889d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:12.734764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f595c-2848-4842-a702-06cd3e889d5e admin admin] PATH_INFO: `/v3/projects/0e2083ed600f4d3586c544cb28589e95/users/cea1a2204f864e92b481b2e0c5afde39/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:12.750486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f595c-2848-4842-a702-06cd3e889d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2083ed600f4d3586c544cb28589e95, user_id=cea1a2204f864e92b481b2e0c5afde39, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:12.753193 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f595c-2848-4842-a702-06cd3e889d5e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:12.880873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 900/1808] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:12 2022] PUT /identity/v3/projects/0e2083ed600f4d3586c544cb28589e95/users/cea1a2204f864e92b481b2e0c5afde39/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:12.885074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc1a8c-a4de-4bf5-9429-32b38ad3c1d0 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:12.894846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc1a8c-a4de-4bf5-9429-32b38ad3c1d0 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:12.965858 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1c3be-12d6-40f3-ae6b-be2c2a0693b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:12.966567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1c3be-12d6-40f3-ae6b-be2c2a0693b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:12.966852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1c3be-12d6-40f3-ae6b-be2c2a0693b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:12.967129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1c3be-12d6-40f3-ae6b-be2c2a0693b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:12.967861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1c3be-12d6-40f3-ae6b-be2c2a0693b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:12.969501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1c3be-12d6-40f3-ae6b-be2c2a0693b3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:12.983276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 909/1809] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:12.984677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f595c-2848-4842-a702-06cd3e889d5e admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:12.995821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f595c-2848-4842-a702-06cd3e889d5e admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:13.000540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aacb6b-bedd-484f-9438-8ddbc727789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:13.001496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aacb6b-bedd-484f-9438-8ddbc727789f admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:13.001868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aacb6b-bedd-484f-9438-8ddbc727789f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:13.002211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aacb6b-bedd-484f-9438-8ddbc727789f admin admin] PATH_INFO: `/v3/projects/0e2083ed600f4d3586c544cb28589e95/users/cea1a2204f864e92b481b2e0c5afde39/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:13.004333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aacb6b-bedd-484f-9438-8ddbc727789f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2083ed600f4d3586c544cb28589e95, user_id=cea1a2204f864e92b481b2e0c5afde39, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:13.007136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aacb6b-bedd-484f-9438-8ddbc727789f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:13.019926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 901/1810] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:12 2022] PUT /identity/v3/projects/0e2083ed600f4d3586c544cb28589e95/users/cea1a2204f864e92b481b2e0c5afde39/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:13.031893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cbae-f2a1-4f28-a14a-bd7c68ad4afd None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:13.032248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cbae-f2a1-4f28-a14a-bd7c68ad4afd None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:13.032631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cbae-f2a1-4f28-a14a-bd7c68ad4afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:13.060701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7256cbae-f2a1-4f28-a14a-bd7c68ad4afd None None] MFA Rules not processed for user `cea1a2204f864e92b481b2e0c5afde39`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:13.061972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7256cbae-f2a1-4f28-a14a-bd7c68ad4afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:13.132402 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 910/1811] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:13.143893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aacb6b-bedd-484f-9438-8ddbc727789f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:13.204888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aacb6b-bedd-484f-9438-8ddbc727789f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:13.208571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bef09-c88b-4839-9622-f7f6dc7d57de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:13.209215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bef09-c88b-4839-9622-f7f6dc7d57de service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:13.209494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bef09-c88b-4839-9622-f7f6dc7d57de service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:13.209766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bef09-c88b-4839-9622-f7f6dc7d57de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:13.271894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bef09-c88b-4839-9622-f7f6dc7d57de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:13.273503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bef09-c88b-4839-9622-f7f6dc7d57de service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:13.283480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 902/1812] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:13.286852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:13.384649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:17.349684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:17.818190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:19.397244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256cbae-f2a1-4f28-a14a-bd7c68ad4afd None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:19.467167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256cbae-f2a1-4f28-a14a-bd7c68ad4afd None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:19.471743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:19.472581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:19.472860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:19.473167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] PATH_INFO: `/v3/users/f46dbb3de17f440ba8da2ebb2516bf19` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:19.474329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46dbb3de17f440ba8da2ebb2516bf19)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:19.476239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:19.788012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46dbb3de17f440ba8da2ebb2516bf19'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:20.059903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46dbb3de17f440ba8da2ebb2516bf19'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:20.060615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46dbb3de17f440ba8da2ebb2516bf19'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:20.071670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46dbb3de17f440ba8da2ebb2516bf19'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:20.074599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46dbb3de17f440ba8da2ebb2516bf19'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:20.108896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 911/1813] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:19 2022] DELETE /identity/v3/users/f46dbb3de17f440ba8da2ebb2516bf19 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:20.113954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2ca55-01bd-4429-b6ed-74f114a8508f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:20.114818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2ca55-01bd-4429-b6ed-74f114a8508f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:20.117233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2ca55-01bd-4429-b6ed-74f114a8508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:20.143509 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-38b2ca55-01bd-4429-b6ed-74f114a8508f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:20.148926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-38b2ca55-01bd-4429-b6ed-74f114a8508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:20.253423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 903/1814] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:20.266970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:20.268624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:20.337887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f7faf-e347-49ac-a04e-ff493ad0e502 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:20.342685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e86b-d5e9-4ec3-8a64-b463e6a2817b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:20.343344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e86b-d5e9-4ec3-8a64-b463e6a2817b service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:20.343636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e86b-d5e9-4ec3-8a64-b463e6a2817b service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:20.343927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e86b-d5e9-4ec3-8a64-b463e6a2817b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:20.360639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5e86b-d5e9-4ec3-8a64-b463e6a2817b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:20.362446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5e86b-d5e9-4ec3-8a64-b463e6a2817b service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:20.377160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2ca55-01bd-4429-b6ed-74f114a8508f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:20.379983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-38b2ca55-01bd-4429-b6ed-74f114a8508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:20.383592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 912/1815] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:20.399081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2ca55-01bd-4429-b6ed-74f114a8508f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:20.407242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:20.408496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:20.408876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:20.409641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] PATH_INFO: `/v3/users/12be8e87b72c49e8b8f6e0a6cc60d7ea` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:20.410747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12be8e87b72c49e8b8f6e0a6cc60d7ea)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:20.413039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:20.713331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12be8e87b72c49e8b8f6e0a6cc60d7ea'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:20.714661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12be8e87b72c49e8b8f6e0a6cc60d7ea'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:20.740169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12be8e87b72c49e8b8f6e0a6cc60d7ea'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:20.767017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12be8e87b72c49e8b8f6e0a6cc60d7ea'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:20.954163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12be8e87b72c49e8b8f6e0a6cc60d7ea'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:21.003723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 904/1816] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:20 2022] DELETE /identity/v3/users/12be8e87b72c49e8b8f6e0a6cc60d7ea => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:21.008125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b757e1-8438-4324-9c47-8ee90058923c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:21.008941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b757e1-8438-4324-9c47-8ee90058923c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:21.009232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b757e1-8438-4324-9c47-8ee90058923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:21.029932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-87b757e1-8438-4324-9c47-8ee90058923c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:21.031278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-87b757e1-8438-4324-9c47-8ee90058923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:21.116627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 913/1817] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:21.202211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:21.204415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:21.348859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c577c-7c07-4af1-9c93-b7d4bee63126 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:21.352953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5ae6f-fe23-496c-b025-99bae64a4546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:21.353631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5ae6f-fe23-496c-b025-99bae64a4546 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:21.355007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5ae6f-fe23-496c-b025-99bae64a4546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:21.355007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5ae6f-fe23-496c-b025-99bae64a4546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:21.378367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5ae6f-fe23-496c-b025-99bae64a4546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:21.379903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5ae6f-fe23-496c-b025-99bae64a4546 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:21.395788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 905/1818] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:21.856484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b757e1-8438-4324-9c47-8ee90058923c None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:21.858176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-87b757e1-8438-4324-9c47-8ee90058923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:21.880029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b757e1-8438-4324-9c47-8ee90058923c None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:21.899097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:21.901883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:21.902344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:21.902798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] PATH_INFO: `/v3/projects/68e3f35852c7401bae3337a4c80474d4` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:21.904231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e3f35852c7401bae3337a4c80474d4)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:21.909812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:22.112798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e3f35852c7401bae3337a4c80474d4', 'request_id': 'req-b191b816-49f6-4bce-b9f5-55b4b8698f5d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.122266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e3f35852c7401bae3337a4c80474d4', 'request_id': 'req-b191b816-49f6-4bce-b9f5-55b4b8698f5d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.257098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e3f35852c7401bae3337a4c80474d4', 'request_id': 'req-b191b816-49f6-4bce-b9f5-55b4b8698f5d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.268880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] The token cache is being invalidate because project 68e3f35852c7401bae3337a4c80474d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:22.269175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.269829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.271406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 914/1819] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:21 2022] DELETE /identity/v3/projects/68e3f35852c7401bae3337a4c80474d4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:22.275615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5ae6f-fe23-496c-b025-99bae64a4546 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:22.289529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5ae6f-fe23-496c-b025-99bae64a4546 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:22.292058 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:22.293660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:22.365950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:22.367368 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:22.367712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:22.368204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] PATH_INFO: `/v3/users/f301410590d54c76b20986af33aaa745` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:22.370862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f301410590d54c76b20986af33aaa745)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:22.372959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:22.378798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b816-49f6-4bce-b9f5-55b4b8698f5d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:22.384309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:22.388894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:22.389323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:22.389611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] PATH_INFO: `/v3/projects/a26c7761ecb44bd4946d7bf15fc6e0a8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:22.391162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26c7761ecb44bd4946d7bf15fc6e0a8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:22.393376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:22.592911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f301410590d54c76b20986af33aaa745'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.593871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f301410590d54c76b20986af33aaa745'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.603355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26c7761ecb44bd4946d7bf15fc6e0a8', 'request_id': 'req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.604046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f301410590d54c76b20986af33aaa745'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.610692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26c7761ecb44bd4946d7bf15fc6e0a8', 'request_id': 'req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.625292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f301410590d54c76b20986af33aaa745'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.732122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26c7761ecb44bd4946d7bf15fc6e0a8', 'request_id': 'req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.748845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] The token cache is being invalidate because project a26c7761ecb44bd4946d7bf15fc6e0a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:22.749542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.750080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.752091 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 915/1820] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:22 2022] DELETE /identity/v3/projects/a26c7761ecb44bd4946d7bf15fc6e0a8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:22.755809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:22.757261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:22.811552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f301410590d54c76b20986af33aaa745'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:22.818785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 906/1821] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:22 2022] DELETE /identity/v3/users/f301410590d54c76b20986af33aaa745 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:22.833312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb63dc2-8d3c-40f2-8b06-6e24719b8d9e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:22.900748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:22.901754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:22.902043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:22.902318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] PATH_INFO: `/v3/users/0746b32237d64652906655bab90aad02` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:22.903799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0746b32237d64652906655bab90aad02)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:22.905804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:23.055687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:23.057923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:23.159196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0746b32237d64652906655bab90aad02'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:23.181119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85caeac-5b3b-4d2c-87ec-07715f796188 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:23.187219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:23.188288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:23.189014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:23.189321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:23.191272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:23.194857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:23.223008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0746b32237d64652906655bab90aad02'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:23.223810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0746b32237d64652906655bab90aad02'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:23.225110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0746b32237d64652906655bab90aad02'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:23.242923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0746b32237d64652906655bab90aad02'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:23.252333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:23.280734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 916/1822] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:22 2022] DELETE /identity/v3/users/0746b32237d64652906655bab90aad02 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:23.281798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:23.284055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:23.298755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 907/1823] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:23.745113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:23.746786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:23.768819 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:23.770544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:23.788143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff699e7-0b9e-4cf3-8be8-12c7f0b7bb70 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:23.878996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:23.881535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:23.881827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:23.882098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] PATH_INFO: `/v3/projects/62c849c90b7548ed97d7a100b1da1a6f` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:23.886610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c849c90b7548ed97d7a100b1da1a6f)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:23.888584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:23.898857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08783200-a7b6-40f4-b885-2bc1546f66ce admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:23.907421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:23.908267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:23.908582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:23.908879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] PATH_INFO: `/v3/projects/d1e307f50df647f0ab034c6dd163d7fc` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:23.910287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e307f50df647f0ab034c6dd163d7fc)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:23.914942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.005423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c849c90b7548ed97d7a100b1da1a6f', 'request_id': 'req-e89fae01-500e-42c7-a6ce-3c986b7ff91c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.063531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e307f50df647f0ab034c6dd163d7fc', 'request_id': 'req-3d902a00-8ae1-4400-8d96-139df2e1f26c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.069042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e307f50df647f0ab034c6dd163d7fc', 'request_id': 'req-3d902a00-8ae1-4400-8d96-139df2e1f26c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.079761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c849c90b7548ed97d7a100b1da1a6f', 'request_id': 'req-e89fae01-500e-42c7-a6ce-3c986b7ff91c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.087882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c849c90b7548ed97d7a100b1da1a6f', 'request_id': 'req-e89fae01-500e-42c7-a6ce-3c986b7ff91c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.101591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] The token cache is being invalidate because project 62c849c90b7548ed97d7a100b1da1a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:24.101873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.102551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e89fae01-500e-42c7-a6ce-3c986b7ff91c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.105163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 908/1824] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:23 2022] DELETE /identity/v3/projects/62c849c90b7548ed97d7a100b1da1a6f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:24.109926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7216f-4414-45e1-8de3-3dedd2851289 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.110217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7216f-4414-45e1-8de3-3dedd2851289 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.110494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7216f-4414-45e1-8de3-3dedd2851289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.129468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b7a7216f-4414-45e1-8de3-3dedd2851289 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:24.130710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b7a7216f-4414-45e1-8de3-3dedd2851289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:24.189438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 909/1825] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:24.198147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b4cf0-1b6c-4ce6-bb2d-8a748055d806 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.198542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b4cf0-1b6c-4ce6-bb2d-8a748055d806 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.198827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b4cf0-1b6c-4ce6-bb2d-8a748055d806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.217115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b71b4cf0-1b6c-4ce6-bb2d-8a748055d806 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:24.218310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b71b4cf0-1b6c-4ce6-bb2d-8a748055d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:24.226255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 910/1826] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:24.230440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b4cf0-1b6c-4ce6-bb2d-8a748055d806 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.234764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e307f50df647f0ab034c6dd163d7fc', 'request_id': 'req-3d902a00-8ae1-4400-8d96-139df2e1f26c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.239726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b4cf0-1b6c-4ce6-bb2d-8a748055d806 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.244950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.245883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.246450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.246744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.247549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:24.253252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.253252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.257875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] The token cache is being invalidate because project d1e307f50df647f0ab034c6dd163d7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:24.258122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.259200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d902a00-8ae1-4400-8d96-139df2e1f26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:24.263109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 917/1827] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:23 2022] DELETE /identity/v3/projects/d1e307f50df647f0ab034c6dd163d7fc => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:24.264060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 911/1828] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:46:24.268129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.269828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:24.273818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86cbca-49e4-42a1-ab05-521ebea6533d None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.274589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86cbca-49e4-42a1-ab05-521ebea6533d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.275147 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86cbca-49e4-42a1-ab05-521ebea6533d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.285825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79078d6e-1d20-4efa-b46e-f00361407f46 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.293754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53529-777d-4ba4-bcd3-58dd310e227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.295751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53529-777d-4ba4-bcd3-58dd310e227b admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.295751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53529-777d-4ba4-bcd3-58dd310e227b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.295751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53529-777d-4ba4-bcd3-58dd310e227b admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.295751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc53529-777d-4ba4-bcd3-58dd310e227b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.297967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc53529-777d-4ba4-bcd3-58dd310e227b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.302706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7c86cbca-49e4-42a1-ab05-521ebea6533d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:24.304105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7c86cbca-49e4-42a1-ab05-521ebea6533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:24.314464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 918/1829] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:24.321678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26264-5f58-4a11-be0f-c1c6b08d8911 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.321939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26264-5f58-4a11-be0f-c1c6b08d8911 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.322366 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26264-5f58-4a11-be0f-c1c6b08d8911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.340950 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-62c26264-5f58-4a11-be0f-c1c6b08d8911 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:24.342173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-62c26264-5f58-4a11-be0f-c1c6b08d8911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:24.350519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 919/1830] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:24.354299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26264-5f58-4a11-be0f-c1c6b08d8911 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.363339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26264-5f58-4a11-be0f-c1c6b08d8911 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.367927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7efb32-6f5f-47ec-a505-6faa194b406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.373503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7efb32-6f5f-47ec-a505-6faa194b406b admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.373503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7efb32-6f5f-47ec-a505-6faa194b406b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.373503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7efb32-6f5f-47ec-a505-6faa194b406b admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.373503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7efb32-6f5f-47ec-a505-6faa194b406b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:24.373503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7efb32-6f5f-47ec-a505-6faa194b406b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.373503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7efb32-6f5f-47ec-a505-6faa194b406b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.383870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 920/1831] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:46:24.388797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7efb32-6f5f-47ec-a505-6faa194b406b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.398264 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7efb32-6f5f-47ec-a505-6faa194b406b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.403370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842a8c4-84ba-4c68-8c5e-0696e7aa1b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.404137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842a8c4-84ba-4c68-8c5e-0696e7aa1b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.404496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842a8c4-84ba-4c68-8c5e-0696e7aa1b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.404772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842a8c4-84ba-4c68-8c5e-0696e7aa1b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.405450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842a8c4-84ba-4c68-8c5e-0696e7aa1b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.413586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842a8c4-84ba-4c68-8c5e-0696e7aa1b27 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.464264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 912/1832] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:24 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:24.468211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53529-777d-4ba4-bcd3-58dd310e227b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.529495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53529-777d-4ba4-bcd3-58dd310e227b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.534399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befdf0a-e111-421a-a4e0-e2e939da132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.535148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befdf0a-e111-421a-a4e0-e2e939da132e admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.535447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befdf0a-e111-421a-a4e0-e2e939da132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.535726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befdf0a-e111-421a-a4e0-e2e939da132e admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.536444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befdf0a-e111-421a-a4e0-e2e939da132e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.538378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befdf0a-e111-421a-a4e0-e2e939da132e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.584735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 921/1833] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:24 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:24.588680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842a8c4-84ba-4c68-8c5e-0696e7aa1b27 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.651194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842a8c4-84ba-4c68-8c5e-0696e7aa1b27 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.655919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd54e4-1346-4c65-8d56-0a202fc120d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.656606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd54e4-1346-4c65-8d56-0a202fc120d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.656890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd54e4-1346-4c65-8d56-0a202fc120d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.657225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd54e4-1346-4c65-8d56-0a202fc120d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.668572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd54e4-1346-4c65-8d56-0a202fc120d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.668572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd54e4-1346-4c65-8d56-0a202fc120d0 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.707107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 913/1834] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:24 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:24.708199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befdf0a-e111-421a-a4e0-e2e939da132e admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.718640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befdf0a-e111-421a-a4e0-e2e939da132e admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.723264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d5dd-ad3a-48a5-9b2f-a039cde158e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.724285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d5dd-ad3a-48a5-9b2f-a039cde158e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.724603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d5dd-ad3a-48a5-9b2f-a039cde158e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.730287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d5dd-ad3a-48a5-9b2f-a039cde158e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.730287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0d5dd-ad3a-48a5-9b2f-a039cde158e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.730287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0d5dd-ad3a-48a5-9b2f-a039cde158e1 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.739005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 914/1835] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:24.742836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d5dd-ad3a-48a5-9b2f-a039cde158e1 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.753570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d5dd-ad3a-48a5-9b2f-a039cde158e1 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.758382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871171dc-1aff-4797-a422-fbd7c5bba6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.759050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871171dc-1aff-4797-a422-fbd7c5bba6ea admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.759332 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871171dc-1aff-4797-a422-fbd7c5bba6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.759610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871171dc-1aff-4797-a422-fbd7c5bba6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.760507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871171dc-1aff-4797-a422-fbd7c5bba6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.762112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871171dc-1aff-4797-a422-fbd7c5bba6ea admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.772867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 915/1836] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:24.777428 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871171dc-1aff-4797-a422-fbd7c5bba6ea admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.783966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 922/1837] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:24 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:24.787390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd54e4-1346-4c65-8d56-0a202fc120d0 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.788187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871171dc-1aff-4797-a422-fbd7c5bba6ea admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.794396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6373bb-e7fe-4b4a-b170-8aa4d794ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.795127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6373bb-e7fe-4b4a-b170-8aa4d794ee18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.795413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6373bb-e7fe-4b4a-b170-8aa4d794ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.795689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6373bb-e7fe-4b4a-b170-8aa4d794ee18 admin admin] PATH_INFO: `/v3/projects/189a51676510482c9c44e00646f4ba38/users/77b6e3d97c4d4c8aa514bd2c20048142/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.798718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd54e4-1346-4c65-8d56-0a202fc120d0 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.804304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982109-9e18-4aa1-bf38-e7f44fb0793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.805140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982109-9e18-4aa1-bf38-e7f44fb0793e admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.810021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982109-9e18-4aa1-bf38-e7f44fb0793e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.810021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982109-9e18-4aa1-bf38-e7f44fb0793e admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.810021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1982109-9e18-4aa1-bf38-e7f44fb0793e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.810021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1982109-9e18-4aa1-bf38-e7f44fb0793e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.812928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6373bb-e7fe-4b4a-b170-8aa4d794ee18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189a51676510482c9c44e00646f4ba38, user_id=77b6e3d97c4d4c8aa514bd2c20048142, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.815623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6373bb-e7fe-4b4a-b170-8aa4d794ee18 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.825972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 923/1838] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:24.835770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982109-9e18-4aa1-bf38-e7f44fb0793e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.846266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982109-9e18-4aa1-bf38-e7f44fb0793e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.851148 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2f60e-4aef-4bd3-9cc6-f7d6f6b1cc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.851819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2f60e-4aef-4bd3-9cc6-f7d6f6b1cc67 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.852901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2f60e-4aef-4bd3-9cc6-f7d6f6b1cc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.852901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2f60e-4aef-4bd3-9cc6-f7d6f6b1cc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.854738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2f60e-4aef-4bd3-9cc6-f7d6f6b1cc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.856965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2f60e-4aef-4bd3-9cc6-f7d6f6b1cc67 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:24.868568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 924/1839] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:24.872737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2f60e-4aef-4bd3-9cc6-f7d6f6b1cc67 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:24.883368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2f60e-4aef-4bd3-9cc6-f7d6f6b1cc67 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:24.886554 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 916/1840] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:24 2022] PUT /identity/v3/projects/189a51676510482c9c44e00646f4ba38/users/77b6e3d97c4d4c8aa514bd2c20048142/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:24.893810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865a8f2-1731-4290-9cbd-23376759d9f1 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.894159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865a8f2-1731-4290-9cbd-23376759d9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.894886 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865a8f2-1731-4290-9cbd-23376759d9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.915019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9865a8f2-1731-4290-9cbd-23376759d9f1 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:24.916839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9865a8f2-1731-4290-9cbd-23376759d9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:24.951771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a2ca6-8a03-4176-89d4-b9aec21c63e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:24.953505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a2ca6-8a03-4176-89d4-b9aec21c63e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:24.954379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a2ca6-8a03-4176-89d4-b9aec21c63e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:24.954379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a2ca6-8a03-4176-89d4-b9aec21c63e0 admin admin] PATH_INFO: `/v3/projects/647ad0e953ef477a913b4079b733c7c4/users/3ac6e51a7a294c839d128e83555ee1f6/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:24.975823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a2ca6-8a03-4176-89d4-b9aec21c63e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647ad0e953ef477a913b4079b733c7c4, user_id=3ac6e51a7a294c839d128e83555ee1f6, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:24.980432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a2ca6-8a03-4176-89d4-b9aec21c63e0 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:25.032856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 917/1841] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:25.041962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865a8f2-1731-4290-9cbd-23376759d9f1 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:25.043381 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9865a8f2-1731-4290-9cbd-23376759d9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:25.114648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865a8f2-1731-4290-9cbd-23376759d9f1 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:25.115001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 925/1842] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:24 2022] PUT /identity/v3/projects/647ad0e953ef477a913b4079b733c7c4/users/3ac6e51a7a294c839d128e83555ee1f6/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:25.126781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f104e0-461c-4452-9e78-2579dc48b913 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:25.127035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f104e0-461c-4452-9e78-2579dc48b913 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:25.127317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f104e0-461c-4452-9e78-2579dc48b913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:25.157087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b2f104e0-461c-4452-9e78-2579dc48b913 None None] MFA Rules not processed for user `3ac6e51a7a294c839d128e83555ee1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:25.158351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b2f104e0-461c-4452-9e78-2579dc48b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:25.177877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11965-258d-42ba-a82d-7ee4205c6300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:25.178571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11965-258d-42ba-a82d-7ee4205c6300 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:25.178860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11965-258d-42ba-a82d-7ee4205c6300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:25.180975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11965-258d-42ba-a82d-7ee4205c6300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:25.263588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 926/1843] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:25.268108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f104e0-461c-4452-9e78-2579dc48b913 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:25.268645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc11965-258d-42ba-a82d-7ee4205c6300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:25.270201 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc11965-258d-42ba-a82d-7ee4205c6300 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:25.281089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f104e0-461c-4452-9e78-2579dc48b913 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:25.282118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 918/1844] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:25.286603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c169b-bb38-48e4-9a88-a9991fba942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:25.287301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c169b-bb38-48e4-9a88-a9991fba942f admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:25.287778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c169b-bb38-48e4-9a88-a9991fba942f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:25.288064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c169b-bb38-48e4-9a88-a9991fba942f admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:25.288855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c169b-bb38-48e4-9a88-a9991fba942f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:25.291624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c169b-bb38-48e4-9a88-a9991fba942f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:25.410410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 927/1845] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:25 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:25.415408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11965-258d-42ba-a82d-7ee4205c6300 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:25.428965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11965-258d-42ba-a82d-7ee4205c6300 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:25.499032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edd8af-9428-4d2d-b5a5-317f9e1968f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:25.500008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edd8af-9428-4d2d-b5a5-317f9e1968f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:25.500487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edd8af-9428-4d2d-b5a5-317f9e1968f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:25.500763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edd8af-9428-4d2d-b5a5-317f9e1968f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:25.501468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edd8af-9428-4d2d-b5a5-317f9e1968f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:25.503487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edd8af-9428-4d2d-b5a5-317f9e1968f9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:25.649399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 919/1846] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:25 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:25.654208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c169b-bb38-48e4-9a88-a9991fba942f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:25.668249 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c169b-bb38-48e4-9a88-a9991fba942f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:25.675868 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d152cd-94eb-42e9-91e7-4b0e96d69932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:25.677401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d152cd-94eb-42e9-91e7-4b0e96d69932 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:25.677703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d152cd-94eb-42e9-91e7-4b0e96d69932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:25.679698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d152cd-94eb-42e9-91e7-4b0e96d69932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:25.680514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d152cd-94eb-42e9-91e7-4b0e96d69932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:25.682615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d152cd-94eb-42e9-91e7-4b0e96d69932 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:25.697775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 928/1847] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:25.701840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edd8af-9428-4d2d-b5a5-317f9e1968f9 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:25.714806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edd8af-9428-4d2d-b5a5-317f9e1968f9 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:25.721444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3de2-cd40-4713-b69b-76eb6cddc781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:25.722427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3de2-cd40-4713-b69b-76eb6cddc781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:25.723426 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3de2-cd40-4713-b69b-76eb6cddc781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:25.723426 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3de2-cd40-4713-b69b-76eb6cddc781 admin admin] PATH_INFO: `/v3/projects/37046b29ae73483ea7de2c3536e5c546/users/d7ab061a599e453a9af25416f520ba47/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:25.742373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a3de2-cd40-4713-b69b-76eb6cddc781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37046b29ae73483ea7de2c3536e5c546, user_id=d7ab061a599e453a9af25416f520ba47, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:25.745679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a3de2-cd40-4713-b69b-76eb6cddc781 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:25.854710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 920/1848] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:25 2022] PUT /identity/v3/projects/37046b29ae73483ea7de2c3536e5c546/users/d7ab061a599e453a9af25416f520ba47/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:25.861454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d152cd-94eb-42e9-91e7-4b0e96d69932 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:25.876864 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d152cd-94eb-42e9-91e7-4b0e96d69932 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:25.971986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933387e-5a40-491b-9cda-32ecd09b3cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:25.972731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933387e-5a40-491b-9cda-32ecd09b3cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:25.973021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933387e-5a40-491b-9cda-32ecd09b3cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:25.973297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933387e-5a40-491b-9cda-32ecd09b3cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:25.974067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933387e-5a40-491b-9cda-32ecd09b3cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:25.975800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933387e-5a40-491b-9cda-32ecd09b3cdd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:25.987072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 929/1849] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:25.991513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3de2-cd40-4713-b69b-76eb6cddc781 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:26.003084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3de2-cd40-4713-b69b-76eb6cddc781 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:26.008804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a32a9-c5e9-4278-88db-4e6807193232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:26.009713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a32a9-c5e9-4278-88db-4e6807193232 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:26.010703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a32a9-c5e9-4278-88db-4e6807193232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:26.011437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a32a9-c5e9-4278-88db-4e6807193232 admin admin] PATH_INFO: `/v3/projects/37046b29ae73483ea7de2c3536e5c546/users/d7ab061a599e453a9af25416f520ba47/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:26.015077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a32a9-c5e9-4278-88db-4e6807193232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37046b29ae73483ea7de2c3536e5c546, user_id=d7ab061a599e453a9af25416f520ba47, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:26.022635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a32a9-c5e9-4278-88db-4e6807193232 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:26.034591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 921/1850] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:25 2022] PUT /identity/v3/projects/37046b29ae73483ea7de2c3536e5c546/users/d7ab061a599e453a9af25416f520ba47/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:26.044986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1506-b571-4030-a8cc-1e8b2a324ea1 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:26.045537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1506-b571-4030-a8cc-1e8b2a324ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:26.046069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1506-b571-4030-a8cc-1e8b2a324ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:26.083283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b6bc1506-b571-4030-a8cc-1e8b2a324ea1 None None] MFA Rules not processed for user `d7ab061a599e453a9af25416f520ba47`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:26.084570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b6bc1506-b571-4030-a8cc-1e8b2a324ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:26.165516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 930/1851] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:26.176219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a32a9-c5e9-4278-88db-4e6807193232 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:26.178113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d02a32a9-c5e9-4278-88db-4e6807193232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:26.269991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a32a9-c5e9-4278-88db-4e6807193232 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:26.274960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc528517-018f-43c8-aaad-05462a3d752f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:26.277215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc528517-018f-43c8-aaad-05462a3d752f service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:26.277215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc528517-018f-43c8-aaad-05462a3d752f service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:26.277215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc528517-018f-43c8-aaad-05462a3d752f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:26.287286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc528517-018f-43c8-aaad-05462a3d752f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:26.288751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc528517-018f-43c8-aaad-05462a3d752f service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:26.301620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 922/1852] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:26.664277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:26.886537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:27.249958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d28666-4b50-4ad0-aff3-8991852f6a30 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:27.250181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d28666-4b50-4ad0-aff3-8991852f6a30 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:27.250467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d28666-4b50-4ad0-aff3-8991852f6a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:27.294133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-88d28666-4b50-4ad0-aff3-8991852f6a30 None None] MFA Rules not processed for user `77b6e3d97c4d4c8aa514bd2c20048142`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:27.295760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-88d28666-4b50-4ad0-aff3-8991852f6a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:27.418914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 931/1853] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:27.423614 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc528517-018f-43c8-aaad-05462a3d752f service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:27.502860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc528517-018f-43c8-aaad-05462a3d752f service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:27.514018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e7677-d0c0-405e-a68d-6499c2db290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:27.514018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e7677-d0c0-405e-a68d-6499c2db290b admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:27.515086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e7677-d0c0-405e-a68d-6499c2db290b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:27.515678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e7677-d0c0-405e-a68d-6499c2db290b admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:27.516068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e7677-d0c0-405e-a68d-6499c2db290b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:27.520706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e7677-d0c0-405e-a68d-6499c2db290b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:27.655736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 923/1854] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:27 2022] POST /identity/v3/projects => generated 371 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:27.660271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d28666-4b50-4ad0-aff3-8991852f6a30 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:27.694549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d28666-4b50-4ad0-aff3-8991852f6a30 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:27.766443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fca3e-d2b4-4ecb-8d6b-8ece21e316af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:27.767165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fca3e-d2b4-4ecb-8d6b-8ece21e316af admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:27.767449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fca3e-d2b4-4ecb-8d6b-8ece21e316af admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:27.771921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fca3e-d2b4-4ecb-8d6b-8ece21e316af admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:27.771921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fca3e-d2b4-4ecb-8d6b-8ece21e316af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:27.771921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fca3e-d2b4-4ecb-8d6b-8ece21e316af admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:27.912323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 932/1855] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:27 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:27.913436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e7677-d0c0-405e-a68d-6499c2db290b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:27.924003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e7677-d0c0-405e-a68d-6499c2db290b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:27.928651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab88c7c-2941-4040-a961-b09a08009f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:27.929325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab88c7c-2941-4040-a961-b09a08009f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:27.929602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab88c7c-2941-4040-a961-b09a08009f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:27.929879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab88c7c-2941-4040-a961-b09a08009f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:27.930636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab88c7c-2941-4040-a961-b09a08009f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:27.932770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab88c7c-2941-4040-a961-b09a08009f58 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:27.944277 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 924/1856] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:27.950017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fca3e-d2b4-4ecb-8d6b-8ece21e316af admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:27.960687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fca3e-d2b4-4ecb-8d6b-8ece21e316af admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:27.965506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067a0b-0595-42c2-8b7f-5131b5d42785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:27.966381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067a0b-0595-42c2-8b7f-5131b5d42785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:27.966668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067a0b-0595-42c2-8b7f-5131b5d42785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:27.966938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067a0b-0595-42c2-8b7f-5131b5d42785 admin admin] PATH_INFO: `/v3/projects/2c1fd62621ec47528060092afc95e5cf/users/8366da7cbc784b9d870c916a7538fb23/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:27.982083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a067a0b-0595-42c2-8b7f-5131b5d42785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1fd62621ec47528060092afc95e5cf, user_id=8366da7cbc784b9d870c916a7538fb23, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:27.984850 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a067a0b-0595-42c2-8b7f-5131b5d42785 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:28.132427 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 933/1857] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:27 2022] PUT /identity/v3/projects/2c1fd62621ec47528060092afc95e5cf/users/8366da7cbc784b9d870c916a7538fb23/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:28.137336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab88c7c-2941-4040-a961-b09a08009f58 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:28.150351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab88c7c-2941-4040-a961-b09a08009f58 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:28.206653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c6ba9-e970-4648-b644-c344a222c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:28.207329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c6ba9-e970-4648-b644-c344a222c8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:28.207611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c6ba9-e970-4648-b644-c344a222c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:28.207885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c6ba9-e970-4648-b644-c344a222c8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:28.208648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c6ba9-e970-4648-b644-c344a222c8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:28.210243 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c6ba9-e970-4648-b644-c344a222c8b0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:28.220392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 925/1858] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:28.224877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067a0b-0595-42c2-8b7f-5131b5d42785 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:28.236485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067a0b-0595-42c2-8b7f-5131b5d42785 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:28.241432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aeb08-c068-4e62-bd3a-f928855263d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:28.242254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aeb08-c068-4e62-bd3a-f928855263d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:28.242541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aeb08-c068-4e62-bd3a-f928855263d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:28.242821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aeb08-c068-4e62-bd3a-f928855263d4 admin admin] PATH_INFO: `/v3/projects/2c1fd62621ec47528060092afc95e5cf/users/8366da7cbc784b9d870c916a7538fb23/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:28.246240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0aeb08-c068-4e62-bd3a-f928855263d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1fd62621ec47528060092afc95e5cf, user_id=8366da7cbc784b9d870c916a7538fb23, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:28.249117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0aeb08-c068-4e62-bd3a-f928855263d4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:28.265837 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 934/1859] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:28 2022] PUT /identity/v3/projects/2c1fd62621ec47528060092afc95e5cf/users/8366da7cbc784b9d870c916a7538fb23/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:29.286048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:29.418037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:30.247692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd7a7-3b42-4be8-ae02-5128ac8b6557 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:30.248081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd7a7-3b42-4be8-ae02-5128ac8b6557 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:30.248589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd7a7-3b42-4be8-ae02-5128ac8b6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:30.273959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:30.285436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6c9fd7a7-3b42-4be8-ae02-5128ac8b6557 None None] MFA Rules not processed for user `8366da7cbc784b9d870c916a7538fb23`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:30.288050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6c9fd7a7-3b42-4be8-ae02-5128ac8b6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:30.391690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 926/1860] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:30.407502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aeb08-c068-4e62-bd3a-f928855263d4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:30.410646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-aa0aeb08-c068-4e62-bd3a-f928855263d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:30.481901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aeb08-c068-4e62-bd3a-f928855263d4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:30.486166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a18830-ef14-45d3-a664-ffd72cbf4ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:30.486821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a18830-ef14-45d3-a664-ffd72cbf4ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:30.487099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a18830-ef14-45d3-a664-ffd72cbf4ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:30.487373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a18830-ef14-45d3-a664-ffd72cbf4ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:30.546565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a18830-ef14-45d3-a664-ffd72cbf4ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:30.547999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a18830-ef14-45d3-a664-ffd72cbf4ae5 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:30.566526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 935/1861] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:30.614644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd7a7-3b42-4be8-ae02-5128ac8b6557 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:30.691019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd7a7-3b42-4be8-ae02-5128ac8b6557 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:30.697761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:30.699115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:30.699558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:30.699993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] PATH_INFO: `/v3/users/3ac6e51a7a294c839d128e83555ee1f6` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:30.701741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac6e51a7a294c839d128e83555ee1f6)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:30.704105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:31.003104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac6e51a7a294c839d128e83555ee1f6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:31.003819 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac6e51a7a294c839d128e83555ee1f6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:31.011415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac6e51a7a294c839d128e83555ee1f6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:31.023559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac6e51a7a294c839d128e83555ee1f6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:31.083526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a18830-ef14-45d3-a664-ffd72cbf4ae5 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:31.085234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-94a18830-ef14-45d3-a664-ffd72cbf4ae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:31.099483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a18830-ef14-45d3-a664-ffd72cbf4ae5 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:31.104164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:31.105072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:31.105358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:31.105637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] PATH_INFO: `/v3/users/116d0a9a7df341c2a133fe9df1e1c636` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:31.106948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=116d0a9a7df341c2a133fe9df1e1c636)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:31.109074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:31.177272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3a39f5a6-dbc4-4ebb-9d20-0c4ba00dbac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac6e51a7a294c839d128e83555ee1f6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:31.185313 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 927/1862] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:30 2022] DELETE /identity/v3/users/3ac6e51a7a294c839d128e83555ee1f6 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:31.189687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84474b-95b6-4c5e-8867-bfef484a035a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:31.189997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84474b-95b6-4c5e-8867-bfef484a035a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:31.190299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84474b-95b6-4c5e-8867-bfef484a035a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:31.209238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0f84474b-95b6-4c5e-8867-bfef484a035a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:31.210516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0f84474b-95b6-4c5e-8867-bfef484a035a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:31.316679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 928/1863] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:31.338184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84474b-95b6-4c5e-8867-bfef484a035a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:31.339782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0f84474b-95b6-4c5e-8867-bfef484a035a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:31.478005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84474b-95b6-4c5e-8867-bfef484a035a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:31.482320 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8339e47-1f95-4719-ac36-ec3835ce5853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:31.483138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339e47-1f95-4719-ac36-ec3835ce5853 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:31.483564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339e47-1f95-4719-ac36-ec3835ce5853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:31.483947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339e47-1f95-4719-ac36-ec3835ce5853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:31.496856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8339e47-1f95-4719-ac36-ec3835ce5853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:31.498475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8339e47-1f95-4719-ac36-ec3835ce5853 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:31.510121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 929/1864] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:31.782375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116d0a9a7df341c2a133fe9df1e1c636'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.152789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116d0a9a7df341c2a133fe9df1e1c636'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.156694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116d0a9a7df341c2a133fe9df1e1c636'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.163860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116d0a9a7df341c2a133fe9df1e1c636'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.172701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116d0a9a7df341c2a133fe9df1e1c636'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.200455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0939e29-8caf-4d1a-a961-528f7ca17ce8 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:32.201015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0939e29-8caf-4d1a-a961-528f7ca17ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:32.201015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0939e29-8caf-4d1a-a961-528f7ca17ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:32.202876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 936/1865] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:31 2022] DELETE /identity/v3/users/116d0a9a7df341c2a133fe9df1e1c636 => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:32.238690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b0939e29-8caf-4d1a-a961-528f7ca17ce8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:32.240224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b0939e29-8caf-4d1a-a961-528f7ca17ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:32.297119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:32.362987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 930/1866] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:32.377092 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:32.378575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:32.442857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6355d44-a1e8-426a-9563-65e0f63df320 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:32.446583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5de57e-f50e-4ec3-90b9-2315a72aeaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:32.447781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de57e-f50e-4ec3-90b9-2315a72aeaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:32.448061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de57e-f50e-4ec3-90b9-2315a72aeaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:32.448374 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de57e-f50e-4ec3-90b9-2315a72aeaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:32.458235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5de57e-f50e-4ec3-90b9-2315a72aeaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:32.459786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5de57e-f50e-4ec3-90b9-2315a72aeaa9 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:32.469583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 937/1867] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:32.560397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0939e29-8caf-4d1a-a961-528f7ca17ce8 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:32.562556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b0939e29-8caf-4d1a-a961-528f7ca17ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:32.576969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0939e29-8caf-4d1a-a961-528f7ca17ce8 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:32.582311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:32.583187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:32.583575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:32.591662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] PATH_INFO: `/v3/projects/647ad0e953ef477a913b4079b733c7c4` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:32.591662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=647ad0e953ef477a913b4079b733c7c4)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:32.591662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:32.692288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647ad0e953ef477a913b4079b733c7c4', 'request_id': 'req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.822718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647ad0e953ef477a913b4079b733c7c4', 'request_id': 'req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.830575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647ad0e953ef477a913b4079b733c7c4', 'request_id': 'req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.842818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] The token cache is being invalidate because project 647ad0e953ef477a913b4079b733c7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:32.843154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.843809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:32.845796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 931/1868] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:32 2022] DELETE /identity/v3/projects/647ad0e953ef477a913b4079b733c7c4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:32.850071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5de57e-f50e-4ec3-90b9-2315a72aeaa9 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:32.860347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5de57e-f50e-4ec3-90b9-2315a72aeaa9 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:32.925352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:32.925352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:32.925352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:32.925352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] PATH_INFO: `/v3/users/d7ab061a599e453a9af25416f520ba47` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:32.925759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:32.925759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:32.925943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ab061a599e453a9af25416f520ba47)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:32.935706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:32.951472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaac9b-a77f-4f24-81fb-476e67dfcac0 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:32.966945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:32.968005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:32.968425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:32.968816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] PATH_INFO: `/v3/projects/3c1edb9f6c514927866c6cef8905142a` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:32.973086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1edb9f6c514927866c6cef8905142a)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:32.976418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:33.139396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1edb9f6c514927866c6cef8905142a', 'request_id': 'req-1423ccdc-c4a1-4692-ba65-391d61047d6c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.141458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ab061a599e453a9af25416f520ba47'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.222288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1edb9f6c514927866c6cef8905142a', 'request_id': 'req-1423ccdc-c4a1-4692-ba65-391d61047d6c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.229158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1edb9f6c514927866c6cef8905142a', 'request_id': 'req-1423ccdc-c4a1-4692-ba65-391d61047d6c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.240431 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] The token cache is being invalidate because project 3c1edb9f6c514927866c6cef8905142a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:33.240719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.241443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.243182 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 932/1869] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:32 2022] DELETE /identity/v3/projects/3c1edb9f6c514927866c6cef8905142a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:33.248053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:33.249449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:33.290893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ab061a599e453a9af25416f520ba47'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.291747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ab061a599e453a9af25416f520ba47'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.293220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ab061a599e453a9af25416f520ba47'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.302471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ab061a599e453a9af25416f520ba47'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.317220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423ccdc-c4a1-4692-ba65-391d61047d6c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:33.324181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:33.324881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 938/1870] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:32 2022] DELETE /identity/v3/users/d7ab061a599e453a9af25416f520ba47 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:33.328643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:33.328842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:33.329873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] PATH_INFO: `/v3/users/cea1a2204f864e92b481b2e0c5afde39` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:33.330466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea1a2204f864e92b481b2e0c5afde39)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:33.332451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:33.590908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:33.593373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:33.598452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea1a2204f864e92b481b2e0c5afde39'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.599224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea1a2204f864e92b481b2e0c5afde39'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.607764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea1a2204f864e92b481b2e0c5afde39'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.628160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea1a2204f864e92b481b2e0c5afde39'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.655410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea51b8a-2e26-4b32-a0c2-a00954dd5f77 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:33.659025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4d7a1-3f5b-476b-948f-b87c971a810f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:33.659677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4d7a1-3f5b-476b-948f-b87c971a810f service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:33.659961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4d7a1-3f5b-476b-948f-b87c971a810f service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:33.660236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4d7a1-3f5b-476b-948f-b87c971a810f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:33.662283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-46e4d7a1-3f5b-476b-948f-b87c971a810f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:33.726257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4d7a1-3f5b-476b-948f-b87c971a810f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:33.727716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4d7a1-3f5b-476b-948f-b87c971a810f service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:33.730561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea1a2204f864e92b481b2e0c5afde39'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:33.737005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 933/1871] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:33 2022] DELETE /identity/v3/users/cea1a2204f864e92b481b2e0c5afde39 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:33.741855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 939/1872] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:33.840207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:33.888868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:33.890361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:33.912694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:34.001015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ff1f-b182-411f-96f9-b068e4c4acc4 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:34.005693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:34.006553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.006836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.007110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] PATH_INFO: `/v3/projects/37046b29ae73483ea7de2c3536e5c546` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.008375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37046b29ae73483ea7de2c3536e5c546)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:34.010374 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:34.172035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37046b29ae73483ea7de2c3536e5c546', 'request_id': 'req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.285253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37046b29ae73483ea7de2c3536e5c546', 'request_id': 'req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.292260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37046b29ae73483ea7de2c3536e5c546', 'request_id': 'req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.302674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] The token cache is being invalidate because project 37046b29ae73483ea7de2c3536e5c546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:34.302976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.303610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.305216 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 934/1873] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:33 2022] DELETE /identity/v3/projects/37046b29ae73483ea7de2c3536e5c546 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:34.310064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d80682-69b6-454a-ad07-53f65f7996ef None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.310529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d80682-69b6-454a-ad07-53f65f7996ef None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.310634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d80682-69b6-454a-ad07-53f65f7996ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.324349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:34.325943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:34.351830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a7d80682-69b6-454a-ad07-53f65f7996ef None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:34.354210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a7d80682-69b6-454a-ad07-53f65f7996ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:34.443889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f0dd-c4fe-46bf-9a6c-4d29062a2c57 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:34.445664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 940/1874] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:34.452436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:34.453399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.453684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.453960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] PATH_INFO: `/v3/projects/0e2083ed600f4d3586c544cb28589e95` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.454521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b01e89-4a94-422e-b81a-7a501d2fb325 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.454817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b01e89-4a94-422e-b81a-7a501d2fb325 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.455106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b01e89-4a94-422e-b81a-7a501d2fb325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.456989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2083ed600f4d3586c544cb28589e95)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:34.458919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:34.473782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-60b01e89-4a94-422e-b81a-7a501d2fb325 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:34.475032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-60b01e89-4a94-422e-b81a-7a501d2fb325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:34.483313 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 941/1875] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:34.487382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b01e89-4a94-422e-b81a-7a501d2fb325 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:34.496200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b01e89-4a94-422e-b81a-7a501d2fb325 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:34.500846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a521a-c2fa-459b-8aca-3205b8680832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:34.501489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a521a-c2fa-459b-8aca-3205b8680832 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.501773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a521a-c2fa-459b-8aca-3205b8680832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.502056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a521a-c2fa-459b-8aca-3205b8680832 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.502775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a521a-c2fa-459b-8aca-3205b8680832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:34.503079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a521a-c2fa-459b-8aca-3205b8680832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:34.504731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a521a-c2fa-459b-8aca-3205b8680832 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:34.516525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 942/1876] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:46:34.520621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a521a-c2fa-459b-8aca-3205b8680832 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:34.530455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a521a-c2fa-459b-8aca-3205b8680832 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:34.535088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63459c7-67c0-4e53-8967-1e6a0d36d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:34.539705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63459c7-67c0-4e53-8967-1e6a0d36d06c admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.539705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63459c7-67c0-4e53-8967-1e6a0d36d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.539705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63459c7-67c0-4e53-8967-1e6a0d36d06c admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.539705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63459c7-67c0-4e53-8967-1e6a0d36d06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:34.539705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63459c7-67c0-4e53-8967-1e6a0d36d06c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:34.583942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2083ed600f4d3586c544cb28589e95', 'request_id': 'req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.685027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 943/1877] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:34 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:34.686345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63459c7-67c0-4e53-8967-1e6a0d36d06c admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:34.703699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2083ed600f4d3586c544cb28589e95', 'request_id': 'req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.721347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2083ed600f4d3586c544cb28589e95', 'request_id': 'req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.736137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] The token cache is being invalidate because project 0e2083ed600f4d3586c544cb28589e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:34.736739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.737413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26e872f5-4ba9-4b06-9b5a-217e3dda1bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:34.739492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 935/1878] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:34 2022] DELETE /identity/v3/projects/0e2083ed600f4d3586c544cb28589e95 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:34.745855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4924e-28e8-4080-b967-fda7f032f91c None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.746257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4924e-28e8-4080-b967-fda7f032f91c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.746597 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4924e-28e8-4080-b967-fda7f032f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.757908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63459c7-67c0-4e53-8967-1e6a0d36d06c admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:34.771203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e96130-2488-4e31-9af2-63028a6f362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:34.772429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e96130-2488-4e31-9af2-63028a6f362f admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.772904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e96130-2488-4e31-9af2-63028a6f362f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.773523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e96130-2488-4e31-9af2-63028a6f362f admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.774503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e96130-2488-4e31-9af2-63028a6f362f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:34.774688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-16e4924e-28e8-4080-b967-fda7f032f91c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:34.776078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-16e4924e-28e8-4080-b967-fda7f032f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:34.777656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e96130-2488-4e31-9af2-63028a6f362f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:34.788048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 936/1879] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:34.796656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141cc01-cd39-4f24-bfeb-d624e8e6707f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.796939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141cc01-cd39-4f24-bfeb-d624e8e6707f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.797218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141cc01-cd39-4f24-bfeb-d624e8e6707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.816168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8141cc01-cd39-4f24-bfeb-d624e8e6707f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:34.817490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8141cc01-cd39-4f24-bfeb-d624e8e6707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:34.826923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 937/1880] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:34.831048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141cc01-cd39-4f24-bfeb-d624e8e6707f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:34.840597 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141cc01-cd39-4f24-bfeb-d624e8e6707f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:34.845202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8ab25-f2ef-4ef5-96fd-3b6cbe8d76f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:34.847160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8ab25-f2ef-4ef5-96fd-3b6cbe8d76f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.847160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8ab25-f2ef-4ef5-96fd-3b6cbe8d76f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.847160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8ab25-f2ef-4ef5-96fd-3b6cbe8d76f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.847160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8ab25-f2ef-4ef5-96fd-3b6cbe8d76f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:34.847573 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8ab25-f2ef-4ef5-96fd-3b6cbe8d76f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:34.849002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8ab25-f2ef-4ef5-96fd-3b6cbe8d76f6 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:34.860480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 938/1881] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:46:34.864727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8ab25-f2ef-4ef5-96fd-3b6cbe8d76f6 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:34.874924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8ab25-f2ef-4ef5-96fd-3b6cbe8d76f6 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:34.879549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1913a4d-952d-4e69-a8c3-5620f53e3da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:34.880145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1913a4d-952d-4e69-a8c3-5620f53e3da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.880468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1913a4d-952d-4e69-a8c3-5620f53e3da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.880751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1913a4d-952d-4e69-a8c3-5620f53e3da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.881440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1913a4d-952d-4e69-a8c3-5620f53e3da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:34.883349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1913a4d-952d-4e69-a8c3-5620f53e3da3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:34.906070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 944/1882] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:34 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:34.910113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e96130-2488-4e31-9af2-63028a6f362f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:34.911804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-40e96130-2488-4e31-9af2-63028a6f362f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:34.924620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e96130-2488-4e31-9af2-63028a6f362f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:34.929394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e54cc-77ab-4c8d-ba3e-7dcf44891047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:34.929996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e54cc-77ab-4c8d-ba3e-7dcf44891047 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.930286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e54cc-77ab-4c8d-ba3e-7dcf44891047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.930567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e54cc-77ab-4c8d-ba3e-7dcf44891047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.931963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e54cc-77ab-4c8d-ba3e-7dcf44891047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:34.933817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e54cc-77ab-4c8d-ba3e-7dcf44891047 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:34.943982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 945/1883] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:34.948027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e54cc-77ab-4c8d-ba3e-7dcf44891047 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:34.958023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e54cc-77ab-4c8d-ba3e-7dcf44891047 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:34.962803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a901a-7f03-44d6-b50d-782cc81b69e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:34.963454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a901a-7f03-44d6-b50d-782cc81b69e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:34.963738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a901a-7f03-44d6-b50d-782cc81b69e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:34.964013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a901a-7f03-44d6-b50d-782cc81b69e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:34.964829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a901a-7f03-44d6-b50d-782cc81b69e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:34.966417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a901a-7f03-44d6-b50d-782cc81b69e7 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:34.976884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 946/1884] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:34.981434 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a901a-7f03-44d6-b50d-782cc81b69e7 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:34.991271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a901a-7f03-44d6-b50d-782cc81b69e7 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.000667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b62bd2-1f99-4dc0-8bdb-015b775472f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.002449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b62bd2-1f99-4dc0-8bdb-015b775472f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.002449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b62bd2-1f99-4dc0-8bdb-015b775472f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.002449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b62bd2-1f99-4dc0-8bdb-015b775472f6 admin admin] PATH_INFO: `/v3/projects/23647975847e4d6e813701412b24bffa/users/73bb90505bab42e5acdd8ded85df4200/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.019022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b62bd2-1f99-4dc0-8bdb-015b775472f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23647975847e4d6e813701412b24bffa, user_id=73bb90505bab42e5acdd8ded85df4200, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.022121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b62bd2-1f99-4dc0-8bdb-015b775472f6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.025421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 939/1885] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:34 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:35.030085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1913a4d-952d-4e69-a8c3-5620f53e3da3 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.098841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 947/1886] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:34 2022] PUT /identity/v3/projects/23647975847e4d6e813701412b24bffa/users/73bb90505bab42e5acdd8ded85df4200/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:35.105852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1913a4d-952d-4e69-a8c3-5620f53e3da3 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.111238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575aa04-5f99-4e23-a634-ac6b18cdf090 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.111523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575aa04-5f99-4e23-a634-ac6b18cdf090 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.112025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575aa04-5f99-4e23-a634-ac6b18cdf090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.142283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d575aa04-5f99-4e23-a634-ac6b18cdf090 None None] MFA Rules not processed for user `73bb90505bab42e5acdd8ded85df4200`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:35.143426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d575aa04-5f99-4e23-a634-ac6b18cdf090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:35.227424 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068b327-a8c0-4805-8a02-b6b443881469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.229626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068b327-a8c0-4805-8a02-b6b443881469 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.229759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068b327-a8c0-4805-8a02-b6b443881469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.229954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068b327-a8c0-4805-8a02-b6b443881469 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.230655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068b327-a8c0-4805-8a02-b6b443881469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.232660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068b327-a8c0-4805-8a02-b6b443881469 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.256676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 948/1887] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:35.260887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575aa04-5f99-4e23-a634-ac6b18cdf090 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.271893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575aa04-5f99-4e23-a634-ac6b18cdf090 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.278702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c0526-12a4-418d-b46f-578daa16996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.279591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c0526-12a4-418d-b46f-578daa16996e admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.280426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c0526-12a4-418d-b46f-578daa16996e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.280964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c0526-12a4-418d-b46f-578daa16996e admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.281869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c0526-12a4-418d-b46f-578daa16996e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.284111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c0526-12a4-418d-b46f-578daa16996e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.331818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 940/1888] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:35 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:35.335843 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068b327-a8c0-4805-8a02-b6b443881469 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.349530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068b327-a8c0-4805-8a02-b6b443881469 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.357014 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 949/1889] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:35 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:35.357526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff67d42-f692-4957-b59e-9c4bc2b69326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.357526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff67d42-f692-4957-b59e-9c4bc2b69326 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.357526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff67d42-f692-4957-b59e-9c4bc2b69326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.357526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff67d42-f692-4957-b59e-9c4bc2b69326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.357834 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff67d42-f692-4957-b59e-9c4bc2b69326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.358713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff67d42-f692-4957-b59e-9c4bc2b69326 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.359093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c0526-12a4-418d-b46f-578daa16996e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.370307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 941/1890] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:35.375456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff67d42-f692-4957-b59e-9c4bc2b69326 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.390620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff67d42-f692-4957-b59e-9c4bc2b69326 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.455072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c0526-12a4-418d-b46f-578daa16996e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.461415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ca43a-07dc-42f6-ab66-49e32478b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.464539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ca43a-07dc-42f6-ab66-49e32478b4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.464850 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ca43a-07dc-42f6-ab66-49e32478b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.465189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ca43a-07dc-42f6-ab66-49e32478b4ea admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.466056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ca43a-07dc-42f6-ab66-49e32478b4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.468261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ca43a-07dc-42f6-ab66-49e32478b4ea admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.470864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55d8d3-cd24-4cbf-8cfe-dec4a6c91938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.470864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55d8d3-cd24-4cbf-8cfe-dec4a6c91938 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.470864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55d8d3-cd24-4cbf-8cfe-dec4a6c91938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.470864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55d8d3-cd24-4cbf-8cfe-dec4a6c91938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.471187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55d8d3-cd24-4cbf-8cfe-dec4a6c91938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.472790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55d8d3-cd24-4cbf-8cfe-dec4a6c91938 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.495275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 942/1891] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:35.495275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55d8d3-cd24-4cbf-8cfe-dec4a6c91938 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.507023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55d8d3-cd24-4cbf-8cfe-dec4a6c91938 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.512962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89871a08-a373-485a-8b3a-6f21d2b75bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.513940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89871a08-a373-485a-8b3a-6f21d2b75bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.514719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89871a08-a373-485a-8b3a-6f21d2b75bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.514719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89871a08-a373-485a-8b3a-6f21d2b75bc8 admin admin] PATH_INFO: `/v3/projects/d1e13fad2755432db7d9a795a2c3e49b/users/beaf2b1e9ab9457494e85043c19f7ff2/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.546680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89871a08-a373-485a-8b3a-6f21d2b75bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e13fad2755432db7d9a795a2c3e49b, user_id=beaf2b1e9ab9457494e85043c19f7ff2, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.550167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89871a08-a373-485a-8b3a-6f21d2b75bc8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.566955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 950/1892] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:35 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:35.570871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ca43a-07dc-42f6-ab66-49e32478b4ea admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.582815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ca43a-07dc-42f6-ab66-49e32478b4ea admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.588385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a7e0b-a7b7-4f94-92fd-57af68f71d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.589173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a7e0b-a7b7-4f94-92fd-57af68f71d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.589665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a7e0b-a7b7-4f94-92fd-57af68f71d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.589938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a7e0b-a7b7-4f94-92fd-57af68f71d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.590819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a7e0b-a7b7-4f94-92fd-57af68f71d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.593055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a7e0b-a7b7-4f94-92fd-57af68f71d93 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.606887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 951/1893] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:35.612894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a7e0b-a7b7-4f94-92fd-57af68f71d93 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.624131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a7e0b-a7b7-4f94-92fd-57af68f71d93 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.629287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4172b92-783f-4cdf-a591-f89202f94630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.640421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4172b92-783f-4cdf-a591-f89202f94630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.640421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4172b92-783f-4cdf-a591-f89202f94630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.640421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4172b92-783f-4cdf-a591-f89202f94630 admin admin] PATH_INFO: `/v3/projects/f543581775d94956ac7d1c2cd00584fa/users/19cc7e52f87148eb91207729207afd20/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.640686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 943/1894] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:35 2022] PUT /identity/v3/projects/d1e13fad2755432db7d9a795a2c3e49b/users/beaf2b1e9ab9457494e85043c19f7ff2/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:35.647892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4172b92-783f-4cdf-a591-f89202f94630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f543581775d94956ac7d1c2cd00584fa, user_id=19cc7e52f87148eb91207729207afd20, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.648452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b40b7-1ea7-4bf4-9c75-9d9e9f6007df None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.648738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b40b7-1ea7-4bf4-9c75-9d9e9f6007df None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.649013 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b40b7-1ea7-4bf4-9c75-9d9e9f6007df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.651595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4172b92-783f-4cdf-a591-f89202f94630 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.677972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-669b40b7-1ea7-4bf4-9c75-9d9e9f6007df None None] MFA Rules not processed for user `beaf2b1e9ab9457494e85043c19f7ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:35.679292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-669b40b7-1ea7-4bf4-9c75-9d9e9f6007df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:35.750810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 944/1895] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:35.751998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b40b7-1ea7-4bf4-9c75-9d9e9f6007df None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.778631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 952/1896] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:35 2022] PUT /identity/v3/projects/f543581775d94956ac7d1c2cd00584fa/users/19cc7e52f87148eb91207729207afd20/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:35.784804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4172b92-783f-4cdf-a591-f89202f94630 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.824567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b40b7-1ea7-4bf4-9c75-9d9e9f6007df None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.856618 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4172b92-783f-4cdf-a591-f89202f94630 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.862484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c13d4-3134-4b96-9363-ce9e6f1b763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.863453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c13d4-3134-4b96-9363-ce9e6f1b763b admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.863932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c13d4-3134-4b96-9363-ce9e6f1b763b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.864665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c13d4-3134-4b96-9363-ce9e6f1b763b admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.865843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c13d4-3134-4b96-9363-ce9e6f1b763b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.867923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c13d4-3134-4b96-9363-ce9e6f1b763b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.879121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 953/1897] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:35.883110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c13d4-3134-4b96-9363-ce9e6f1b763b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:35.895059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c13d4-3134-4b96-9363-ce9e6f1b763b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:35.899908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75bdaa-3ea6-44e8-8523-f28917e7b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.901169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75bdaa-3ea6-44e8-8523-f28917e7b1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.901378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634f7b6-f784-4cd6-b016-4b00993da0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:35.901637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75bdaa-3ea6-44e8-8523-f28917e7b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.902005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75bdaa-3ea6-44e8-8523-f28917e7b1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.902571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634f7b6-f784-4cd6-b016-4b00993da0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.902930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634f7b6-f784-4cd6-b016-4b00993da0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.903282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634f7b6-f784-4cd6-b016-4b00993da0f6 admin admin] PATH_INFO: `/v3/projects/f543581775d94956ac7d1c2cd00584fa/users/19cc7e52f87148eb91207729207afd20/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.903463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75bdaa-3ea6-44e8-8523-f28917e7b1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.905731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75bdaa-3ea6-44e8-8523-f28917e7b1c5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.905851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634f7b6-f784-4cd6-b016-4b00993da0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f543581775d94956ac7d1c2cd00584fa, user_id=19cc7e52f87148eb91207729207afd20, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:35.908859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634f7b6-f784-4cd6-b016-4b00993da0f6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:35.920569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 954/1898] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:35 2022] PUT /identity/v3/projects/f543581775d94956ac7d1c2cd00584fa/users/19cc7e52f87148eb91207729207afd20/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:35.930459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562d15d-600f-497b-ab46-eb6e72b71db9 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:35.930805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562d15d-600f-497b-ab46-eb6e72b71db9 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:35.931089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562d15d-600f-497b-ab46-eb6e72b71db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:35.959632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-4562d15d-600f-497b-ab46-eb6e72b71db9 None None] MFA Rules not processed for user `19cc7e52f87148eb91207729207afd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:35.960892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4562d15d-600f-497b-ab46-eb6e72b71db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:36.037555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 945/1899] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:35 2022] POST /identity/v3/projects => generated 375 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:36.044751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75bdaa-3ea6-44e8-8523-f28917e7b1c5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:36.060474 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 955/1900] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:36.081573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562d15d-600f-497b-ab46-eb6e72b71db9 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:36.084330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4562d15d-600f-497b-ab46-eb6e72b71db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:36.130914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:36.139312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75bdaa-3ea6-44e8-8523-f28917e7b1c5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:36.155083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0593-81cc-439a-ba8c-a873ebc59551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:36.155833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0593-81cc-439a-ba8c-a873ebc59551 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:36.156177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0593-81cc-439a-ba8c-a873ebc59551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:36.157135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0593-81cc-439a-ba8c-a873ebc59551 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:36.158321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0593-81cc-439a-ba8c-a873ebc59551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:36.164658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0593-81cc-439a-ba8c-a873ebc59551 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:36.188823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562d15d-600f-497b-ab46-eb6e72b71db9 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:36.220144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:36.256762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 946/1901] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:36 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:36.257876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0593-81cc-439a-ba8c-a873ebc59551 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:36.284906 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0593-81cc-439a-ba8c-a873ebc59551 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:36.294288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b05e9b-522c-4c0b-9071-827b82b3c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:36.295136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b05e9b-522c-4c0b-9071-827b82b3c73a admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:36.295424 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b05e9b-522c-4c0b-9071-827b82b3c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:36.295736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b05e9b-522c-4c0b-9071-827b82b3c73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:36.296659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b05e9b-522c-4c0b-9071-827b82b3c73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:36.298131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b05e9b-522c-4c0b-9071-827b82b3c73a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:36.310476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 947/1902] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:36.314723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b05e9b-522c-4c0b-9071-827b82b3c73a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:36.315896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b255d68-cc5f-43a6-a37d-573abf47dff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:36.317832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255d68-cc5f-43a6-a37d-573abf47dff7 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:36.317832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255d68-cc5f-43a6-a37d-573abf47dff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:36.317832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255d68-cc5f-43a6-a37d-573abf47dff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:36.338835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b05e9b-522c-4c0b-9071-827b82b3c73a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:36.344690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519bdf-e1dd-4456-8148-2765e74355a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:36.345596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519bdf-e1dd-4456-8148-2765e74355a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:36.345887 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519bdf-e1dd-4456-8148-2765e74355a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:36.346169 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519bdf-e1dd-4456-8148-2765e74355a5 admin admin] PATH_INFO: `/v3/projects/babcdb11e2f14725b1a4574df01e0a6b/users/4907a6c82b174aed8d4b68de989f6375/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:36.371888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af519bdf-e1dd-4456-8148-2765e74355a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=babcdb11e2f14725b1a4574df01e0a6b, user_id=4907a6c82b174aed8d4b68de989f6375, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:36.374654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af519bdf-e1dd-4456-8148-2765e74355a5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:36.391497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b255d68-cc5f-43a6-a37d-573abf47dff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:36.393165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b255d68-cc5f-43a6-a37d-573abf47dff7 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:36.419709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 956/1903] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:36.467012 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 948/1904] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:36 2022] PUT /identity/v3/projects/babcdb11e2f14725b1a4574df01e0a6b/users/4907a6c82b174aed8d4b68de989f6375/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:36.471024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b255d68-cc5f-43a6-a37d-573abf47dff7 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:36.482327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b255d68-cc5f-43a6-a37d-573abf47dff7 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:36.541970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5231a8a-35a1-4f90-8ae3-a55e6767bdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:36.542731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231a8a-35a1-4f90-8ae3-a55e6767bdbe admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:36.543043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231a8a-35a1-4f90-8ae3-a55e6767bdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:36.543317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231a8a-35a1-4f90-8ae3-a55e6767bdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:36.544044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5231a8a-35a1-4f90-8ae3-a55e6767bdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:36.545688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5231a8a-35a1-4f90-8ae3-a55e6767bdbe admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:36.556454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519bdf-e1dd-4456-8148-2765e74355a5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:36.558978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-af519bdf-e1dd-4456-8148-2765e74355a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:36.559270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 957/1905] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:36.563211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5231a8a-35a1-4f90-8ae3-a55e6767bdbe admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:36.574396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5231a8a-35a1-4f90-8ae3-a55e6767bdbe admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:36.579799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435fbb3-284d-4c20-a501-358b57c784ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:36.580890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fbb3-284d-4c20-a501-358b57c784ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:36.581173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fbb3-284d-4c20-a501-358b57c784ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:36.581452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fbb3-284d-4c20-a501-358b57c784ac admin admin] PATH_INFO: `/v3/projects/babcdb11e2f14725b1a4574df01e0a6b/users/4907a6c82b174aed8d4b68de989f6375/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:36.584120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435fbb3-284d-4c20-a501-358b57c784ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=babcdb11e2f14725b1a4574df01e0a6b, user_id=4907a6c82b174aed8d4b68de989f6375, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:36.586984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435fbb3-284d-4c20-a501-358b57c784ac admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:36.599691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 958/1906] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:36 2022] PUT /identity/v3/projects/babcdb11e2f14725b1a4574df01e0a6b/users/4907a6c82b174aed8d4b68de989f6375/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:36.618068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa0d03-8fcd-433f-9916-4ba29e6d95e4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:36.627678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519bdf-e1dd-4456-8148-2765e74355a5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:36.633758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa0d03-8fcd-433f-9916-4ba29e6d95e4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:36.637017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa0d03-8fcd-433f-9916-4ba29e6d95e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:36.676195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-33fa0d03-8fcd-433f-9916-4ba29e6d95e4 None None] MFA Rules not processed for user `4907a6c82b174aed8d4b68de989f6375`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:36.676565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-33fa0d03-8fcd-433f-9916-4ba29e6d95e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:36.718481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5376a60-fb4e-4490-a264-ba32cc907785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:36.719301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376a60-fb4e-4490-a264-ba32cc907785 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:36.727119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376a60-fb4e-4490-a264-ba32cc907785 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:36.727119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376a60-fb4e-4490-a264-ba32cc907785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:36.784003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 959/1907] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:36.801670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa0d03-8fcd-433f-9916-4ba29e6d95e4 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:36.815708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa0d03-8fcd-433f-9916-4ba29e6d95e4 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:36.827413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6109-1f53-4055-9060-94e18e451562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:36.828896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6109-1f53-4055-9060-94e18e451562 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:36.830805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6109-1f53-4055-9060-94e18e451562 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:36.831207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6109-1f53-4055-9060-94e18e451562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:36.832226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5376a60-fb4e-4490-a264-ba32cc907785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:36.833993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5376a60-fb4e-4490-a264-ba32cc907785 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:36.847373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 949/1908] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:36.909041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6109-1f53-4055-9060-94e18e451562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:36.910517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6109-1f53-4055-9060-94e18e451562 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:36.923128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 960/1909] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:38.697895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:38.725865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:41.063375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:41.097323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:41.449790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5376a60-fb4e-4490-a264-ba32cc907785 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:41.517799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5376a60-fb4e-4490-a264-ba32cc907785 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:41.523358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:41.524474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:41.524937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:41.525416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] PATH_INFO: `/v3/users/beaf2b1e9ab9457494e85043c19f7ff2` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:41.527180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=beaf2b1e9ab9457494e85043c19f7ff2)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:41.530194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:41.732324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beaf2b1e9ab9457494e85043c19f7ff2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:41.734017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beaf2b1e9ab9457494e85043c19f7ff2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:41.742459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beaf2b1e9ab9457494e85043c19f7ff2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:41.756131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beaf2b1e9ab9457494e85043c19f7ff2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:41.851464 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beaf2b1e9ab9457494e85043c19f7ff2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:41.870923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 950/1910] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:41 2022] DELETE /identity/v3/users/beaf2b1e9ab9457494e85043c19f7ff2 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:41.879139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736888-2301-4c97-8803-320d67c61de6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:41.879622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736888-2301-4c97-8803-320d67c61de6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:41.880062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736888-2301-4c97-8803-320d67c61de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:41.901189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-ba736888-2301-4c97-8803-320d67c61de6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:41.904077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ba736888-2301-4c97-8803-320d67c61de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:41.979149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 961/1911] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:41.993123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:41.996601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:42.091207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73306b6-a03c-442e-bec0-cd917e15a0ef admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:42.097928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78151178-df05-4826-bfc6-3af3414d98de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:42.098650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78151178-df05-4826-bfc6-3af3414d98de service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:42.099039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78151178-df05-4826-bfc6-3af3414d98de service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:42.099507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78151178-df05-4826-bfc6-3af3414d98de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:42.109512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:42.115214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78151178-df05-4826-bfc6-3af3414d98de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:42.115214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78151178-df05-4826-bfc6-3af3414d98de service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:42.124238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 951/1912] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:42.433765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736888-2301-4c97-8803-320d67c61de6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:42.436731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ba736888-2301-4c97-8803-320d67c61de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:42.455827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736888-2301-4c97-8803-320d67c61de6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:42.462246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:42.463718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:42.464161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:42.464567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] PATH_INFO: `/v3/users/73bb90505bab42e5acdd8ded85df4200` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:42.466080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bb90505bab42e5acdd8ded85df4200)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:42.468549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:42.715811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:42.720432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bb90505bab42e5acdd8ded85df4200'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:42.739701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78151178-df05-4826-bfc6-3af3414d98de service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:42.741163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-78151178-df05-4826-bfc6-3af3414d98de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:42.759184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78151178-df05-4826-bfc6-3af3414d98de service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:42.766380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:42.767941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:42.768241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:42.768555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] PATH_INFO: `/v3/projects/d1e13fad2755432db7d9a795a2c3e49b` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:42.770716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e13fad2755432db7d9a795a2c3e49b)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:42.772707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:42.828692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bb90505bab42e5acdd8ded85df4200'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:42.829342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bb90505bab42e5acdd8ded85df4200'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:42.829965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bb90505bab42e5acdd8ded85df4200'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:42.841847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-98ddbec7-6146-45de-8983-3956211f546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bb90505bab42e5acdd8ded85df4200'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:42.876995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 962/1913] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:42 2022] DELETE /identity/v3/users/73bb90505bab42e5acdd8ded85df4200 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:42.878429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab53ac7-0d01-423b-a998-645c74ee2305 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:42.878731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab53ac7-0d01-423b-a998-645c74ee2305 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:42.879079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab53ac7-0d01-423b-a998-645c74ee2305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:42.915744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2ab53ac7-0d01-423b-a998-645c74ee2305 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:42.917749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2ab53ac7-0d01-423b-a998-645c74ee2305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:42.957328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e13fad2755432db7d9a795a2c3e49b', 'request_id': 'req-d025e2ca-725b-495c-9b15-d99f16ebf82a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.001741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 963/1914] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:43.013773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab53ac7-0d01-423b-a998-645c74ee2305 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:43.016510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2ab53ac7-0d01-423b-a998-645c74ee2305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:43.034559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e13fad2755432db7d9a795a2c3e49b', 'request_id': 'req-d025e2ca-725b-495c-9b15-d99f16ebf82a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.044742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e13fad2755432db7d9a795a2c3e49b', 'request_id': 'req-d025e2ca-725b-495c-9b15-d99f16ebf82a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.076881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] The token cache is being invalidate because project d1e13fad2755432db7d9a795a2c3e49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:43.077431 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.078118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.080472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 952/1915] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:42 2022] DELETE /identity/v3/projects/d1e13fad2755432db7d9a795a2c3e49b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:43.085222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:43.086687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:43.094820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab53ac7-0d01-423b-a998-645c74ee2305 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:43.100737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e2ca-725b-495c-9b15-d99f16ebf82a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:43.102243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:43.103024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:43.103173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:43.108997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:43.114813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:43.116650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:43.117138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:43.117138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:43.117419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] PATH_INFO: `/v3/users/4907a6c82b174aed8d4b68de989f6375` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:43.121785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4907a6c82b174aed8d4b68de989f6375)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:43.126756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:43.138673 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:43.141035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:43.152726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 964/1916] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:43.389893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4907a6c82b174aed8d4b68de989f6375'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.390746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4907a6c82b174aed8d4b68de989f6375'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.403872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4907a6c82b174aed8d4b68de989f6375'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.421836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4907a6c82b174aed8d4b68de989f6375'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.452611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:43.547696 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4907a6c82b174aed8d4b68de989f6375'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.553319 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 953/1917] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:43 2022] DELETE /identity/v3/users/4907a6c82b174aed8d4b68de989f6375 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:43.638841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:43.640332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:43.656580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d3fe1-3a89-417b-84f8-ac102afee77e service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:43.767993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:43.768961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:43.769239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:43.769513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] PATH_INFO: `/v3/projects/23647975847e4d6e813701412b24bffa` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:43.770699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23647975847e4d6e813701412b24bffa)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:43.772654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:43.917185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23647975847e4d6e813701412b24bffa', 'request_id': 'req-dd678fda-941b-463d-8d77-4f27908702c8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:43.923354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23647975847e4d6e813701412b24bffa', 'request_id': 'req-dd678fda-941b-463d-8d77-4f27908702c8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.017604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23647975847e4d6e813701412b24bffa', 'request_id': 'req-dd678fda-941b-463d-8d77-4f27908702c8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.029192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] The token cache is being invalidate because project 23647975847e4d6e813701412b24bffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:44.029481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.030114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.031682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 965/1918] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:43 2022] DELETE /identity/v3/projects/23647975847e4d6e813701412b24bffa => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:44.035707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:44.037139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:44.050632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee2b24-f2c4-48a9-8ea2-56aae893b178 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:44.110486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:44.111367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:44.111669 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:44.111920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] PATH_INFO: `/v3/users/19cc7e52f87148eb91207729207afd20` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:44.113403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19cc7e52f87148eb91207729207afd20)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:44.115385 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:44.137849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:44.139017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:44.140713 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:44.155452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd678fda-941b-463d-8d77-4f27908702c8 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:44.161067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:44.162301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:44.166481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:44.166481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] PATH_INFO: `/v3/projects/babcdb11e2f14725b1a4574df01e0a6b` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:44.166481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] RBAC: Authorizing `identity:delete_project(project_id=babcdb11e2f14725b1a4574df01e0a6b)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:44.167142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:44.379562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'babcdb11e2f14725b1a4574df01e0a6b', 'request_id': 'req-9ce0a920-792b-4e86-bee9-658699e3e90c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.379749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19cc7e52f87148eb91207729207afd20'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.380662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19cc7e52f87148eb91207729207afd20'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.385291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'babcdb11e2f14725b1a4574df01e0a6b', 'request_id': 'req-9ce0a920-792b-4e86-bee9-658699e3e90c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.389883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19cc7e52f87148eb91207729207afd20'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.399728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19cc7e52f87148eb91207729207afd20'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.462049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'babcdb11e2f14725b1a4574df01e0a6b', 'request_id': 'req-9ce0a920-792b-4e86-bee9-658699e3e90c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.474408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] The token cache is being invalidate because project babcdb11e2f14725b1a4574df01e0a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:44.474698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.475337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ce0a920-792b-4e86-bee9-658699e3e90c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.477002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 966/1919] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:44 2022] DELETE /identity/v3/projects/babcdb11e2f14725b1a4574df01e0a6b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:44.482135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efcf9c-a69e-46dc-95a0-2cd2a91322d3 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:44.482422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efcf9c-a69e-46dc-95a0-2cd2a91322d3 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:44.482696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efcf9c-a69e-46dc-95a0-2cd2a91322d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:44.500863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-99efcf9c-a69e-46dc-95a0-2cd2a91322d3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:44.502057 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-99efcf9c-a69e-46dc-95a0-2cd2a91322d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:44.508715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4ff9941e-b9dd-41f7-a3c7-2bafcd0c16a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19cc7e52f87148eb91207729207afd20'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:44.516092 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 954/1920] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:44 2022] DELETE /identity/v3/users/19cc7e52f87148eb91207729207afd20 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:44.570206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 967/1921] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:44.578070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729db32-8b5b-4993-b0dc-93edd92933c5 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:44.578578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729db32-8b5b-4993-b0dc-93edd92933c5 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:44.579176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729db32-8b5b-4993-b0dc-93edd92933c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:44.602251 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9729db32-8b5b-4993-b0dc-93edd92933c5 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:44.603805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9729db32-8b5b-4993-b0dc-93edd92933c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:44.669298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 955/1922] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:44.682285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efcf9c-a69e-46dc-95a0-2cd2a91322d3 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:44.695904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efcf9c-a69e-46dc-95a0-2cd2a91322d3 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:44.710161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c823b9-d349-4cc3-b6bb-4e678c1e9782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:44.710161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c823b9-d349-4cc3-b6bb-4e678c1e9782 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:44.710161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c823b9-d349-4cc3-b6bb-4e678c1e9782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:44.710161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c823b9-d349-4cc3-b6bb-4e678c1e9782 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:44.711674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c823b9-d349-4cc3-b6bb-4e678c1e9782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:44.711674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c823b9-d349-4cc3-b6bb-4e678c1e9782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:44.711674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c823b9-d349-4cc3-b6bb-4e678c1e9782 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:44.730284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 968/1923] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:46:44.731298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729db32-8b5b-4993-b0dc-93edd92933c5 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:44.741291 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729db32-8b5b-4993-b0dc-93edd92933c5 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:44.746593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03774fe0-8114-4210-9dc6-fc19965528b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:44.747271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03774fe0-8114-4210-9dc6-fc19965528b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:44.747552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03774fe0-8114-4210-9dc6-fc19965528b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:44.747829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03774fe0-8114-4210-9dc6-fc19965528b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:44.748575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03774fe0-8114-4210-9dc6-fc19965528b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:44.750522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03774fe0-8114-4210-9dc6-fc19965528b9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:44.762167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:44.877269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 956/1924] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:44 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:44.880698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c823b9-d349-4cc3-b6bb-4e678c1e9782 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:44.892425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c823b9-d349-4cc3-b6bb-4e678c1e9782 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:44.966094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324bc1f-f3b5-4fbb-ba45-56a91844971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:44.966775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324bc1f-f3b5-4fbb-ba45-56a91844971d admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:44.967067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324bc1f-f3b5-4fbb-ba45-56a91844971d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:44.967345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324bc1f-f3b5-4fbb-ba45-56a91844971d admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:44.968042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324bc1f-f3b5-4fbb-ba45-56a91844971d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:44.970114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324bc1f-f3b5-4fbb-ba45-56a91844971d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.002015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03774fe0-8114-4210-9dc6-fc19965528b9 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.003810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-03774fe0-8114-4210-9dc6-fc19965528b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:45.017086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03774fe0-8114-4210-9dc6-fc19965528b9 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.021990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.022864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.023276 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.023612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] PATH_INFO: `/v3/projects/f543581775d94956ac7d1c2cd00584fa` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.024943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f543581775d94956ac7d1c2cd00584fa)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.027828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.096717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 969/1925] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:44 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:45.097624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324bc1f-f3b5-4fbb-ba45-56a91844971d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.107881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324bc1f-f3b5-4fbb-ba45-56a91844971d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.112647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9e1e7-04a2-40cf-a436-f8c635357e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.113309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9e1e7-04a2-40cf-a436-f8c635357e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.113594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9e1e7-04a2-40cf-a436-f8c635357e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.113871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9e1e7-04a2-40cf-a436-f8c635357e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.114708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9e1e7-04a2-40cf-a436-f8c635357e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.116198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9e1e7-04a2-40cf-a436-f8c635357e83 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.138082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 970/1926] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:45.145187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f543581775d94956ac7d1c2cd00584fa', 'request_id': 'req-30bcc401-ba75-47f4-9620-69738119a5cf'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:45.169699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9e1e7-04a2-40cf-a436-f8c635357e83 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.169699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9e1e7-04a2-40cf-a436-f8c635357e83 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.217585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473681e0-ca76-4255-be35-932a203b2dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.218256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473681e0-ca76-4255-be35-932a203b2dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.219108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473681e0-ca76-4255-be35-932a203b2dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.219108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473681e0-ca76-4255-be35-932a203b2dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.219667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473681e0-ca76-4255-be35-932a203b2dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.221493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473681e0-ca76-4255-be35-932a203b2dd1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.231656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 971/1927] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:45.235755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473681e0-ca76-4255-be35-932a203b2dd1 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.246285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473681e0-ca76-4255-be35-932a203b2dd1 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.250974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa9e53-30e2-472d-96ec-2f194f92d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.251828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa9e53-30e2-472d-96ec-2f194f92d688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.252117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa9e53-30e2-472d-96ec-2f194f92d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.252431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa9e53-30e2-472d-96ec-2f194f92d688 admin admin] PATH_INFO: `/v3/projects/66a512893ae243c7b7e4573b02134dcf/users/cc6f80a9e37d483d9eb90b1834f115c3/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.257565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f543581775d94956ac7d1c2cd00584fa', 'request_id': 'req-30bcc401-ba75-47f4-9620-69738119a5cf'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:45.265704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f543581775d94956ac7d1c2cd00584fa', 'request_id': 'req-30bcc401-ba75-47f4-9620-69738119a5cf'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:45.269363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa9e53-30e2-472d-96ec-2f194f92d688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a512893ae243c7b7e4573b02134dcf, user_id=cc6f80a9e37d483d9eb90b1834f115c3, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.272087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa9e53-30e2-472d-96ec-2f194f92d688 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.276932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] The token cache is being invalidate because project f543581775d94956ac7d1c2cd00584fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:45.277259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:45.277948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-30bcc401-ba75-47f4-9620-69738119a5cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:45.279637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 957/1928] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:45 2022] DELETE /identity/v3/projects/f543581775d94956ac7d1c2cd00584fa => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:45.284883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466e69-ce4f-4661-8657-588dc566a2ae None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.285172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466e69-ce4f-4661-8657-588dc566a2ae None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.285455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466e69-ce4f-4661-8657-588dc566a2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.303381 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-72466e69-ce4f-4661-8657-588dc566a2ae None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:45.304625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-72466e69-ce4f-4661-8657-588dc566a2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:45.313254 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 958/1929] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:45.321679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9478d9-9cc3-4602-84c7-a486c82f5837 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.321969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9478d9-9cc3-4602-84c7-a486c82f5837 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.322858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9478d9-9cc3-4602-84c7-a486c82f5837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.340976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-aa9478d9-9cc3-4602-84c7-a486c82f5837 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:45.342192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-aa9478d9-9cc3-4602-84c7-a486c82f5837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:45.350074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 959/1930] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:45.354376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9478d9-9cc3-4602-84c7-a486c82f5837 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.363163 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9478d9-9cc3-4602-84c7-a486c82f5837 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.367813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc576-eef1-41b5-8956-c8d2d1d0e2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.368484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc576-eef1-41b5-8956-c8d2d1d0e2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.368770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc576-eef1-41b5-8956-c8d2d1d0e2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.369571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc576-eef1-41b5-8956-c8d2d1d0e2a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.370445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbc576-eef1-41b5-8956-c8d2d1d0e2a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:45.370753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbc576-eef1-41b5-8956-c8d2d1d0e2a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.372378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbc576-eef1-41b5-8956-c8d2d1d0e2a1 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.383486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 960/1931] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:46:45.388800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc576-eef1-41b5-8956-c8d2d1d0e2a1 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.394942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 972/1932] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:45 2022] PUT /identity/v3/projects/66a512893ae243c7b7e4573b02134dcf/users/cc6f80a9e37d483d9eb90b1834f115c3/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:45.398464 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc576-eef1-41b5-8956-c8d2d1d0e2a1 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.408793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b4ab-5fb0-40fa-8642-83136511b796 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.409278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b4ab-5fb0-40fa-8642-83136511b796 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.409556 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b4ab-5fb0-40fa-8642-83136511b796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.437544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a8a1b4ab-5fb0-40fa-8642-83136511b796 None None] MFA Rules not processed for user `cc6f80a9e37d483d9eb90b1834f115c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:45.438836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a8a1b4ab-5fb0-40fa-8642-83136511b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:45.457673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935026c5-faaa-4cec-83e8-afdf6b6cd852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.458343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935026c5-faaa-4cec-83e8-afdf6b6cd852 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.459504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935026c5-faaa-4cec-83e8-afdf6b6cd852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.459504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935026c5-faaa-4cec-83e8-afdf6b6cd852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.459671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935026c5-faaa-4cec-83e8-afdf6b6cd852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.461665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935026c5-faaa-4cec-83e8-afdf6b6cd852 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.505534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 973/1933] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:45.510779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1b4ab-5fb0-40fa-8642-83136511b796 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.512061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a8a1b4ab-5fb0-40fa-8642-83136511b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:45.525187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1b4ab-5fb0-40fa-8642-83136511b796 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.530564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b4b0d-bf8c-4eb1-8cbd-ac76f163082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.531209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4b0d-bf8c-4eb1-8cbd-ac76f163082f admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.531496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4b0d-bf8c-4eb1-8cbd-ac76f163082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.531774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4b0d-bf8c-4eb1-8cbd-ac76f163082f admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.532501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b4b0d-bf8c-4eb1-8cbd-ac76f163082f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.534535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b4b0d-bf8c-4eb1-8cbd-ac76f163082f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.551088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 961/1934] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:45 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:45.555084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935026c5-faaa-4cec-83e8-afdf6b6cd852 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.607262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:45.618703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935026c5-faaa-4cec-83e8-afdf6b6cd852 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.624323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ada5-01cd-476a-bf38-0f295172b70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.625015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ada5-01cd-476a-bf38-0f295172b70c admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.625350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ada5-01cd-476a-bf38-0f295172b70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.625631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ada5-01cd-476a-bf38-0f295172b70c admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.626672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2ada5-01cd-476a-bf38-0f295172b70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.628576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2ada5-01cd-476a-bf38-0f295172b70c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.635839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 974/1935] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:45 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:45.640128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b4b0d-bf8c-4eb1-8cbd-ac76f163082f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.703450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b4b0d-bf8c-4eb1-8cbd-ac76f163082f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.708062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb72e4-7d3c-47c3-9a27-bdff8d9bf7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.708898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb72e4-7d3c-47c3-9a27-bdff8d9bf7de admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.709184 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb72e4-7d3c-47c3-9a27-bdff8d9bf7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.709462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb72e4-7d3c-47c3-9a27-bdff8d9bf7de admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.710152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb72e4-7d3c-47c3-9a27-bdff8d9bf7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.712071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb72e4-7d3c-47c3-9a27-bdff8d9bf7de admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.844178 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 975/1936] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:45 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:45.844441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 962/1937] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:45 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:45.845616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb72e4-7d3c-47c3-9a27-bdff8d9bf7de admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.847447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ada5-01cd-476a-bf38-0f295172b70c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.857154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb72e4-7d3c-47c3-9a27-bdff8d9bf7de admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.859029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ada5-01cd-476a-bf38-0f295172b70c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.862039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409624-12fe-4fc3-b298-f8c7e03229d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.867007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409624-12fe-4fc3-b298-f8c7e03229d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.867007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409624-12fe-4fc3-b298-f8c7e03229d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.867007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409624-12fe-4fc3-b298-f8c7e03229d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.867258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8cb7-248a-4a9b-8cf8-a1f97688b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.867347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f409624-12fe-4fc3-b298-f8c7e03229d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.867419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8cb7-248a-4a9b-8cf8-a1f97688b8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.867419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8cb7-248a-4a9b-8cf8-a1f97688b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.867419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8cb7-248a-4a9b-8cf8-a1f97688b8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.867419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c8cb7-248a-4a9b-8cf8-a1f97688b8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.867661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f409624-12fe-4fc3-b298-f8c7e03229d2 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.867730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c8cb7-248a-4a9b-8cf8-a1f97688b8a2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.876306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 976/1938] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:45.877581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 963/1939] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:45.880273 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409624-12fe-4fc3-b298-f8c7e03229d2 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.881468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8cb7-248a-4a9b-8cf8-a1f97688b8a2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.890658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409624-12fe-4fc3-b298-f8c7e03229d2 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.891057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8cb7-248a-4a9b-8cf8-a1f97688b8a2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.895590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ae47b-ede4-4af8-92e3-7f205b7cbfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.897611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d24da-f0f1-4b95-96e6-463adc8d66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.897730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ae47b-ede4-4af8-92e3-7f205b7cbfaf admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.897821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d24da-f0f1-4b95-96e6-463adc8d66f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.897906 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ae47b-ede4-4af8-92e3-7f205b7cbfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.898005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d24da-f0f1-4b95-96e6-463adc8d66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.898110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ae47b-ede4-4af8-92e3-7f205b7cbfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.898216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d24da-f0f1-4b95-96e6-463adc8d66f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.898301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ae47b-ede4-4af8-92e3-7f205b7cbfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.898401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d24da-f0f1-4b95-96e6-463adc8d66f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.899145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ae47b-ede4-4af8-92e3-7f205b7cbfaf admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.899278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d24da-f0f1-4b95-96e6-463adc8d66f3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.910359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 964/1940] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:45.910880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 977/1941] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:45.914482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ae47b-ede4-4af8-92e3-7f205b7cbfaf admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.914719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d24da-f0f1-4b95-96e6-463adc8d66f3 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:45.925130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d24da-f0f1-4b95-96e6-463adc8d66f3 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.925287 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ae47b-ede4-4af8-92e3-7f205b7cbfaf admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:45.929756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69188c11-0d78-44f2-a1ce-c0b138989fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.929890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b4a8f-b26b-47be-8a44-46f2769a2058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:45.930629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188c11-0d78-44f2-a1ce-c0b138989fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.930914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188c11-0d78-44f2-a1ce-c0b138989fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.931007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b4a8f-b26b-47be-8a44-46f2769a2058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:45.931189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188c11-0d78-44f2-a1ce-c0b138989fa2 admin admin] PATH_INFO: `/v3/projects/411496452b514b418b75b6f845f8f859/users/0d679c6064304000bc78e343afe22959/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.931282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b4a8f-b26b-47be-8a44-46f2769a2058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:45.931519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b4a8f-b26b-47be-8a44-46f2769a2058 admin admin] PATH_INFO: `/v3/projects/b69928c69a9e451188d3e9ad098fca2f/users/cd165ccf5acb4ea3afb9cc4aa92591ba/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:45.945918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69188c11-0d78-44f2-a1ce-c0b138989fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411496452b514b418b75b6f845f8f859, user_id=0d679c6064304000bc78e343afe22959, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.946790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b4a8f-b26b-47be-8a44-46f2769a2058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69928c69a9e451188d3e9ad098fca2f, user_id=cd165ccf5acb4ea3afb9cc4aa92591ba, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:45.948826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69188c11-0d78-44f2-a1ce-c0b138989fa2 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:45.950024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b4a8f-b26b-47be-8a44-46f2769a2058 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.046851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 978/1942] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:45 2022] PUT /identity/v3/projects/411496452b514b418b75b6f845f8f859/users/0d679c6064304000bc78e343afe22959/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:46.057630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fcfcf-5b41-460d-a1dd-c069756668c7 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.057934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fcfcf-5b41-460d-a1dd-c069756668c7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.058218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fcfcf-5b41-460d-a1dd-c069756668c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.058438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 965/1943] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:45 2022] PUT /identity/v3/projects/b69928c69a9e451188d3e9ad098fca2f/users/cd165ccf5acb4ea3afb9cc4aa92591ba/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:46.069309 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c958-c2f6-4e14-aceb-6f2762953b99 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.073238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c958-c2f6-4e14-aceb-6f2762953b99 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.073238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c958-c2f6-4e14-aceb-6f2762953b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.087344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-aa2fcfcf-5b41-460d-a1dd-c069756668c7 None None] MFA Rules not processed for user `0d679c6064304000bc78e343afe22959`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:46.089069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-aa2fcfcf-5b41-460d-a1dd-c069756668c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:46.098415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8596c958-c2f6-4e14-aceb-6f2762953b99 None None] MFA Rules not processed for user `cd165ccf5acb4ea3afb9cc4aa92591ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:46.099584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8596c958-c2f6-4e14-aceb-6f2762953b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:46.155547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 979/1944] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:46.159851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fcfcf-5b41-460d-a1dd-c069756668c7 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.172404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 966/1945] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:46.176593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c958-c2f6-4e14-aceb-6f2762953b99 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.246814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fcfcf-5b41-460d-a1dd-c069756668c7 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.247562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c958-c2f6-4e14-aceb-6f2762953b99 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.252259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efa465-0824-4a49-977c-5c88fcb016fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:46.256372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00103e34-3e60-438d-b56b-123f15efaa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:46.256588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efa465-0824-4a49-977c-5c88fcb016fb admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.256588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efa465-0824-4a49-977c-5c88fcb016fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.256739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00103e34-3e60-438d-b56b-123f15efaa0d admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.256815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efa465-0824-4a49-977c-5c88fcb016fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.256885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00103e34-3e60-438d-b56b-123f15efaa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.256885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00103e34-3e60-438d-b56b-123f15efaa0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.257009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efa465-0824-4a49-977c-5c88fcb016fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:46.257088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00103e34-3e60-438d-b56b-123f15efaa0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:46.257159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efa465-0824-4a49-977c-5c88fcb016fb admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.257457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00103e34-3e60-438d-b56b-123f15efaa0d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.358909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 980/1946] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:46 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:46.362601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efa465-0824-4a49-977c-5c88fcb016fb admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.385094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 967/1947] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:46 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:46.389805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00103e34-3e60-438d-b56b-123f15efaa0d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.449614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efa465-0824-4a49-977c-5c88fcb016fb admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.460659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00103e34-3e60-438d-b56b-123f15efaa0d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.466779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ea227-18f9-42a2-a06c-f6d95bf55518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:46.467888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ea227-18f9-42a2-a06c-f6d95bf55518 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.468199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ea227-18f9-42a2-a06c-f6d95bf55518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.468577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ea227-18f9-42a2-a06c-f6d95bf55518 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.469805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ea227-18f9-42a2-a06c-f6d95bf55518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:46.471493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ea227-18f9-42a2-a06c-f6d95bf55518 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.512937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cfd64-735d-4fcb-a40b-bfc7e3705e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:46.513648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cfd64-735d-4fcb-a40b-bfc7e3705e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.513932 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cfd64-735d-4fcb-a40b-bfc7e3705e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.514205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cfd64-735d-4fcb-a40b-bfc7e3705e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.514904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cfd64-735d-4fcb-a40b-bfc7e3705e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:46.516908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cfd64-735d-4fcb-a40b-bfc7e3705e56 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.550409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 968/1948] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:46 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:46.554536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ea227-18f9-42a2-a06c-f6d95bf55518 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.565627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ea227-18f9-42a2-a06c-f6d95bf55518 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.570489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89a4b-b517-4256-81d0-d5297e9790b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:46.571220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89a4b-b517-4256-81d0-d5297e9790b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.571509 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89a4b-b517-4256-81d0-d5297e9790b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.579756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89a4b-b517-4256-81d0-d5297e9790b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.579756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd89a4b-b517-4256-81d0-d5297e9790b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:46.579756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd89a4b-b517-4256-81d0-d5297e9790b5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.588979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 969/1949] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:46.590093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89a4b-b517-4256-81d0-d5297e9790b5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.601014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89a4b-b517-4256-81d0-d5297e9790b5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.601201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 981/1950] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:46 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:46.606138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cfd64-735d-4fcb-a40b-bfc7e3705e56 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.608913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078fa0e-7f38-4779-b3da-f64ab66b1c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:46.610058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078fa0e-7f38-4779-b3da-f64ab66b1c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.610184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078fa0e-7f38-4779-b3da-f64ab66b1c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.610511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078fa0e-7f38-4779-b3da-f64ab66b1c62 admin admin] PATH_INFO: `/v3/projects/3fec777fa310493e804595af8adbf66c/users/af5a30db4e704086be159b87686c2475/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.616038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cfd64-735d-4fcb-a40b-bfc7e3705e56 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.621030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1658d-d87e-439a-9a35-37c56895f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:46.621901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1658d-d87e-439a-9a35-37c56895f940 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.622454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1658d-d87e-439a-9a35-37c56895f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.622708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1658d-d87e-439a-9a35-37c56895f940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.624140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1658d-d87e-439a-9a35-37c56895f940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:46.626801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:46.628954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1658d-d87e-439a-9a35-37c56895f940 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.638916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078fa0e-7f38-4779-b3da-f64ab66b1c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fec777fa310493e804595af8adbf66c, user_id=af5a30db4e704086be159b87686c2475, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:46.640070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 982/1951] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:46.642358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078fa0e-7f38-4779-b3da-f64ab66b1c62 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.643802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1658d-d87e-439a-9a35-37c56895f940 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.655487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1658d-d87e-439a-9a35-37c56895f940 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.660506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad992a9-00eb-423f-bf2c-ae1ec00b5fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:46.661479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad992a9-00eb-423f-bf2c-ae1ec00b5fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.661770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad992a9-00eb-423f-bf2c-ae1ec00b5fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.662060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad992a9-00eb-423f-bf2c-ae1ec00b5fa6 admin admin] PATH_INFO: `/v3/projects/ad2164c8591143ecbf39a2b9f18f2b00/users/91f1e5364ee14f28b7a5e7a3f476fbb9/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.678524 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad992a9-00eb-423f-bf2c-ae1ec00b5fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2164c8591143ecbf39a2b9f18f2b00, user_id=91f1e5364ee14f28b7a5e7a3f476fbb9, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:46.680578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:46.681909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad992a9-00eb-423f-bf2c-ae1ec00b5fa6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.861749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 983/1952] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:46 2022] PUT /identity/v3/projects/ad2164c8591143ecbf39a2b9f18f2b00/users/91f1e5364ee14f28b7a5e7a3f476fbb9/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:46.865430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad992a9-00eb-423f-bf2c-ae1ec00b5fa6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.866675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 970/1953] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:46 2022] PUT /identity/v3/projects/3fec777fa310493e804595af8adbf66c/users/af5a30db4e704086be159b87686c2475/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:46.871076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078fa0e-7f38-4779-b3da-f64ab66b1c62 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.945022 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078fa0e-7f38-4779-b3da-f64ab66b1c62 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.958291 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94791-4a6c-4db3-a2d3-8cf98f06cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:46.959334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94791-4a6c-4db3-a2d3-8cf98f06cd39 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:46.959835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94791-4a6c-4db3-a2d3-8cf98f06cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:46.960506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94791-4a6c-4db3-a2d3-8cf98f06cd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:46.961314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94791-4a6c-4db3-a2d3-8cf98f06cd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:46.963780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94791-4a6c-4db3-a2d3-8cf98f06cd39 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:46.977408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 971/1954] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:46.981742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94791-4a6c-4db3-a2d3-8cf98f06cd39 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:46.987810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad992a9-00eb-423f-bf2c-ae1ec00b5fa6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:46.996598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c65ef-677e-4e61-ab44-e8cdec220018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:47.004039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c65ef-677e-4e61-ab44-e8cdec220018 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.004039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c65ef-677e-4e61-ab44-e8cdec220018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.004039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c65ef-677e-4e61-ab44-e8cdec220018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.004465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94791-4a6c-4db3-a2d3-8cf98f06cd39 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:47.004578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c65ef-677e-4e61-ab44-e8cdec220018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:47.004578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c65ef-677e-4e61-ab44-e8cdec220018 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:47.004733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b3ed7-bb42-43fd-ba1c-a881f552445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:47.004733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3ed7-bb42-43fd-ba1c-a881f552445c admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.004887 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3ed7-bb42-43fd-ba1c-a881f552445c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.005562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3ed7-bb42-43fd-ba1c-a881f552445c admin admin] PATH_INFO: `/v3/projects/3fec777fa310493e804595af8adbf66c/users/af5a30db4e704086be159b87686c2475/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.007131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b3ed7-bb42-43fd-ba1c-a881f552445c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fec777fa310493e804595af8adbf66c, user_id=af5a30db4e704086be159b87686c2475, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:47.010746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b3ed7-bb42-43fd-ba1c-a881f552445c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:47.019603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 984/1955] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:47.020609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c65ef-677e-4e61-ab44-e8cdec220018 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:47.024514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 972/1956] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:46 2022] PUT /identity/v3/projects/3fec777fa310493e804595af8adbf66c/users/af5a30db4e704086be159b87686c2475/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:47.038156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee59e79-9491-4849-9a63-b67e34b3caf2 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.038450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee59e79-9491-4849-9a63-b67e34b3caf2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.038856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee59e79-9491-4849-9a63-b67e34b3caf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.041773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c65ef-677e-4e61-ab44-e8cdec220018 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:47.072786 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-eee59e79-9491-4849-9a63-b67e34b3caf2 None None] MFA Rules not processed for user `af5a30db4e704086be159b87686c2475`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:47.074349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-eee59e79-9491-4849-9a63-b67e34b3caf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:47.120545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d382547-2315-4573-afcb-8f7574bbde5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:47.121590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d382547-2315-4573-afcb-8f7574bbde5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.122547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d382547-2315-4573-afcb-8f7574bbde5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.122905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d382547-2315-4573-afcb-8f7574bbde5a admin admin] PATH_INFO: `/v3/projects/ad2164c8591143ecbf39a2b9f18f2b00/users/91f1e5364ee14f28b7a5e7a3f476fbb9/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.125072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d382547-2315-4573-afcb-8f7574bbde5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2164c8591143ecbf39a2b9f18f2b00, user_id=91f1e5364ee14f28b7a5e7a3f476fbb9, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:47.127898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d382547-2315-4573-afcb-8f7574bbde5a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:47.140477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 985/1957] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:47 2022] PUT /identity/v3/projects/ad2164c8591143ecbf39a2b9f18f2b00/users/91f1e5364ee14f28b7a5e7a3f476fbb9/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:47.150367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385691f0-a216-4c21-b674-f7f3e6a78a4e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.161549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385691f0-a216-4c21-b674-f7f3e6a78a4e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.161549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385691f0-a216-4c21-b674-f7f3e6a78a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.161767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 973/1958] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:47.174345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee59e79-9491-4849-9a63-b67e34b3caf2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:47.176583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-eee59e79-9491-4849-9a63-b67e34b3caf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:47.179165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-385691f0-a216-4c21-b674-f7f3e6a78a4e None None] MFA Rules not processed for user `91f1e5364ee14f28b7a5e7a3f476fbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:47.180695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-385691f0-a216-4c21-b674-f7f3e6a78a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:47.255435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee59e79-9491-4849-9a63-b67e34b3caf2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:47.261872 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 986/1959] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:47.273708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385691f0-a216-4c21-b674-f7f3e6a78a4e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:47.275331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-385691f0-a216-4c21-b674-f7f3e6a78a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:47.318034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e876-0841-4639-a7cc-6fea5e86c9a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:47.318683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e876-0841-4639-a7cc-6fea5e86c9a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.319031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e876-0841-4639-a7cc-6fea5e86c9a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.319308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e876-0841-4639-a7cc-6fea5e86c9a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.351456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385691f0-a216-4c21-b674-f7f3e6a78a4e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:47.355521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d4de-4ab8-4990-868b-62b8db624672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:47.356175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d4de-4ab8-4990-868b-62b8db624672 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.356486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d4de-4ab8-4990-868b-62b8db624672 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.357194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d4de-4ab8-4990-868b-62b8db624672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.383129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e876-0841-4639-a7cc-6fea5e86c9a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:47.384701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e876-0841-4639-a7cc-6fea5e86c9a7 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:47.395325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 974/1960] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:47.396615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6891df-649a-416f-8345-5e7e74e0e8a3 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.396900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6891df-649a-416f-8345-5e7e74e0e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.397175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6891df-649a-416f-8345-5e7e74e0e8a3 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.398427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 975/1961] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:46:47.403914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9934b-3858-4d91-995d-9ed4ea327488 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.404195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9934b-3858-4d91-995d-9ed4ea327488 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.404501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9934b-3858-4d91-995d-9ed4ea327488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.424588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2cd9934b-3858-4d91-995d-9ed4ea327488 None None] MFA Rules not processed for user `a5997b3965f44d6fbdf55cccdfc52ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:47.424588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2cd9934b-3858-4d91-995d-9ed4ea327488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:47.426000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d4de-4ab8-4990-868b-62b8db624672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:47.427453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d4de-4ab8-4990-868b-62b8db624672 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:47.437297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 987/1962] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:47.438134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d4de-4ab8-4990-868b-62b8db624672 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:47.509371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 976/1963] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:47.510872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9934b-3858-4d91-995d-9ed4ea327488 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:47.512571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2cd9934b-3858-4d91-995d-9ed4ea327488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:47.524587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d4de-4ab8-4990-868b-62b8db624672 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:47.526640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9934b-3858-4d91-995d-9ed4ea327488 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:47.529582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:47.530576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.530837 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.531073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] PATH_INFO: `/v3/users/cd165ccf5acb4ea3afb9cc4aa92591ba` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.532036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:47.532254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd165ccf5acb4ea3afb9cc4aa92591ba)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:47.532971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:47.533445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:47.533646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] PATH_INFO: `/v3/users/8d7100e6b15442e895c72cb41116e76b` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:47.534223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:47.534904 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7100e6b15442e895c72cb41116e76b)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:47.536996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:47.797212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd165ccf5acb4ea3afb9cc4aa92591ba'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:47.844634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7100e6b15442e895c72cb41116e76b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:47.845284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7100e6b15442e895c72cb41116e76b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:47.852138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7100e6b15442e895c72cb41116e76b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:47.864237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7100e6b15442e895c72cb41116e76b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:47.931430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd165ccf5acb4ea3afb9cc4aa92591ba'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:47.932693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd165ccf5acb4ea3afb9cc4aa92591ba'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:47.933297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd165ccf5acb4ea3afb9cc4aa92591ba'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:47.940735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd165ccf5acb4ea3afb9cc4aa92591ba'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:47.957814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 988/1964] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:47 2022] DELETE /identity/v3/users/cd165ccf5acb4ea3afb9cc4aa92591ba => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:47.959348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:47.960757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:48.040368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0782ee8-3b42-4998-80ff-c9275eaa667b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:48.045957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:48.046605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:48.046888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:48.047166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:48.048956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:48.058102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6fb34bea-ed85-48f4-a01c-042adcb38887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7100e6b15442e895c72cb41116e76b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:48.062005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:48.063959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:48.067963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 977/1965] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:47 2022] DELETE /identity/v3/users/8d7100e6b15442e895c72cb41116e76b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:48.067963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475898a9-3fdc-4e13-b44f-9174a6626c2e None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:48.067963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475898a9-3fdc-4e13-b44f-9174a6626c2e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:48.067963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475898a9-3fdc-4e13-b44f-9174a6626c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:48.075038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 989/1966] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:48.102967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-475898a9-3fdc-4e13-b44f-9174a6626c2e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:48.104985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-475898a9-3fdc-4e13-b44f-9174a6626c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:48.179000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 978/1967] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:48.190050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:48.193389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:48.278534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e250d-0eed-440d-bcbb-083ac599e851 service placement] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:48.281397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:48.343487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:48.350135 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b335919-fd19-4bdb-8614-76c2b8f78e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:48.350789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b335919-fd19-4bdb-8614-76c2b8f78e20 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:48.351075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b335919-fd19-4bdb-8614-76c2b8f78e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:48.351351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b335919-fd19-4bdb-8614-76c2b8f78e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:48.360466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b335919-fd19-4bdb-8614-76c2b8f78e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:48.361886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b335919-fd19-4bdb-8614-76c2b8f78e20 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:48.371524 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 990/1968] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:48.441894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475898a9-3fdc-4e13-b44f-9174a6626c2e None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:48.443536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-475898a9-3fdc-4e13-b44f-9174a6626c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:48.463007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475898a9-3fdc-4e13-b44f-9174a6626c2e None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:48.468988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:48.469897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:48.470187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:48.470456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] PATH_INFO: `/v3/projects/fc5c77313d114be8a334b6009147d627` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:48.471680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5c77313d114be8a334b6009147d627)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:48.473871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:48.578707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5c77313d114be8a334b6009147d627', 'request_id': 'req-deba89e8-432c-4910-93a2-4c9d6982dde5'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:48.657766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5c77313d114be8a334b6009147d627', 'request_id': 'req-deba89e8-432c-4910-93a2-4c9d6982dde5'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:48.664774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5c77313d114be8a334b6009147d627', 'request_id': 'req-deba89e8-432c-4910-93a2-4c9d6982dde5'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:48.675976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] The token cache is being invalidate because project fc5c77313d114be8a334b6009147d627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:48.676430 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:48.677092 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-deba89e8-432c-4910-93a2-4c9d6982dde5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:48.679471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 979/1969] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:48 2022] DELETE /identity/v3/projects/fc5c77313d114be8a334b6009147d627 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:48.684483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8722638-5964-447d-8a70-773c5585d3d1 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:48.684946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8722638-5964-447d-8a70-773c5585d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:48.685259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8722638-5964-447d-8a70-773c5585d3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:48.709413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d8722638-5964-447d-8a70-773c5585d3d1 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:48.710741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d8722638-5964-447d-8a70-773c5585d3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:48.771869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 991/1970] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:48.780472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d039d-cf9c-421f-99a1-50464dc0c742 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:48.780760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d039d-cf9c-421f-99a1-50464dc0c742 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:48.781074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d039d-cf9c-421f-99a1-50464dc0c742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:48.799554 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-151d039d-cf9c-421f-99a1-50464dc0c742 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:48.800798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-151d039d-cf9c-421f-99a1-50464dc0c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:48.810021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 980/1971] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:48.814328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8722638-5964-447d-8a70-773c5585d3d1 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:48.823986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8722638-5964-447d-8a70-773c5585d3d1 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:48.828989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5f3d2-5d5a-4469-a254-d578123d41c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:48.829589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5f3d2-5d5a-4469-a254-d578123d41c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:48.829870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5f3d2-5d5a-4469-a254-d578123d41c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:48.830148 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5f3d2-5d5a-4469-a254-d578123d41c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:48.830889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5f3d2-5d5a-4469-a254-d578123d41c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:48.831196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5f3d2-5d5a-4469-a254-d578123d41c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:48.832835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5f3d2-5d5a-4469-a254-d578123d41c9 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:48.838695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d039d-cf9c-421f-99a1-50464dc0c742 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:48.841398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-151d039d-cf9c-421f-99a1-50464dc0c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:48.851019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 992/1972] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:46:48.857308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5f3d2-5d5a-4469-a254-d578123d41c9 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:48.862339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d039d-cf9c-421f-99a1-50464dc0c742 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:48.868578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5f3d2-5d5a-4469-a254-d578123d41c9 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:48.875402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:48.875705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dfcba-a54e-4ddd-aaba-732de32d41b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:48.876493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dfcba-a54e-4ddd-aaba-732de32d41b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:48.876627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:48.876831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dfcba-a54e-4ddd-aaba-732de32d41b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:48.877077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:48.877174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dfcba-a54e-4ddd-aaba-732de32d41b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:48.877649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] PATH_INFO: `/v3/projects/b69928c69a9e451188d3e9ad098fca2f` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:48.877770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dfcba-a54e-4ddd-aaba-732de32d41b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:48.879158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b69928c69a9e451188d3e9ad098fca2f)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:48.879813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dfcba-a54e-4ddd-aaba-732de32d41b6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:48.881693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:49.048175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 993/1973] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:48 2022] POST /identity/v3/projects => generated 403 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:49.052316 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dfcba-a54e-4ddd-aaba-732de32d41b6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:49.083447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b69928c69a9e451188d3e9ad098fca2f', 'request_id': 'req-907e2714-192b-41a9-afee-b8e0d09ee9ef'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.115516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dfcba-a54e-4ddd-aaba-732de32d41b6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:49.172255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd700225-dc4e-4e16-998d-f7e886036f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:49.172960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd700225-dc4e-4e16-998d-f7e886036f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:49.173247 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd700225-dc4e-4e16-998d-f7e886036f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:49.173533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd700225-dc4e-4e16-998d-f7e886036f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:49.174226 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd700225-dc4e-4e16-998d-f7e886036f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:49.176154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd700225-dc4e-4e16-998d-f7e886036f95 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:49.177252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b69928c69a9e451188d3e9ad098fca2f', 'request_id': 'req-907e2714-192b-41a9-afee-b8e0d09ee9ef'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.184783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b69928c69a9e451188d3e9ad098fca2f', 'request_id': 'req-907e2714-192b-41a9-afee-b8e0d09ee9ef'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.195214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] The token cache is being invalidate because project b69928c69a9e451188d3e9ad098fca2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:49.195507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.196184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.198974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 981/1974] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:48 2022] DELETE /identity/v3/projects/b69928c69a9e451188d3e9ad098fca2f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:49.203088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:49.204442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:49.212338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:49.217723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e2714-192b-41a9-afee-b8e0d09ee9ef admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:49.222654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:49.223549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:49.223837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:49.224118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] PATH_INFO: `/v3/users/af5a30db4e704086be159b87686c2475` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:49.225363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5a30db4e704086be159b87686c2475)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:49.227371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:49.276816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 994/1975] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:49 2022] POST /identity/v3/users => generated 302 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:49.280884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd700225-dc4e-4e16-998d-f7e886036f95 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:49.283822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-cd700225-dc4e-4e16-998d-f7e886036f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:49.299505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd700225-dc4e-4e16-998d-f7e886036f95 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:49.305163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6030d8-7fae-4fec-9a11-8ef6b291a119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:49.306303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6030d8-7fae-4fec-9a11-8ef6b291a119 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:49.306920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6030d8-7fae-4fec-9a11-8ef6b291a119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:49.307584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6030d8-7fae-4fec-9a11-8ef6b291a119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:49.308695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6030d8-7fae-4fec-9a11-8ef6b291a119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:49.310740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6030d8-7fae-4fec-9a11-8ef6b291a119 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:49.322277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 995/1976] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:49.326939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6030d8-7fae-4fec-9a11-8ef6b291a119 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:49.340220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6030d8-7fae-4fec-9a11-8ef6b291a119 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:49.348766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dc503-b542-49b8-8ae8-1508909295ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:49.349901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dc503-b542-49b8-8ae8-1508909295ed admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:49.350512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dc503-b542-49b8-8ae8-1508909295ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:49.351291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dc503-b542-49b8-8ae8-1508909295ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:49.352213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dc503-b542-49b8-8ae8-1508909295ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:49.359614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dc503-b542-49b8-8ae8-1508909295ed admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:49.376334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 996/1977] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:49.379259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dc503-b542-49b8-8ae8-1508909295ed admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:49.390573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dc503-b542-49b8-8ae8-1508909295ed admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:49.396949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ca1c4-9166-4de5-9f2e-437a968eb53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:49.397844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ca1c4-9166-4de5-9f2e-437a968eb53e admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:49.398122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ca1c4-9166-4de5-9f2e-437a968eb53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:49.398399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ca1c4-9166-4de5-9f2e-437a968eb53e admin admin] PATH_INFO: `/v3/projects/7831483b838740f091328159bce769b1/users/802e57d8a98841e5aefb9ae4858513b8/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:49.414350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ca1c4-9166-4de5-9f2e-437a968eb53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7831483b838740f091328159bce769b1, user_id=802e57d8a98841e5aefb9ae4858513b8, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:49.417333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ca1c4-9166-4de5-9f2e-437a968eb53e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:49.540876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5a30db4e704086be159b87686c2475'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.541706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5a30db4e704086be159b87686c2475'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.548698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5a30db4e704086be159b87686c2475'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.561419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5a30db4e704086be159b87686c2475'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.595069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 997/1978] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:49 2022] PUT /identity/v3/projects/7831483b838740f091328159bce769b1/users/802e57d8a98841e5aefb9ae4858513b8/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:49.596653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae9ec-68e4-4a73-bd0e-641071748bbb None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:49.596973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae9ec-68e4-4a73-bd0e-641071748bbb None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:49.597255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae9ec-68e4-4a73-bd0e-641071748bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:49.617004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-147ae9ec-68e4-4a73-bd0e-641071748bbb None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:49.618289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-147ae9ec-68e4-4a73-bd0e-641071748bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:49.668699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5a30db4e704086be159b87686c2475'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:49.675755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 982/1979] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:49 2022] DELETE /identity/v3/users/af5a30db4e704086be159b87686c2475 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:49.685172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 998/1980] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:49.696251 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:49.699649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:49.770974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f00e0-cde4-4e09-9b5c-2b4f8011abe6 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:49.777058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7adb20-8fb9-4494-8161-4ea1c64ac10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:49.778204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7adb20-8fb9-4494-8161-4ea1c64ac10a service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:49.778736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7adb20-8fb9-4494-8161-4ea1c64ac10a service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:49.779457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7adb20-8fb9-4494-8161-4ea1c64ac10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:49.819654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ae9ec-68e4-4a73-bd0e-641071748bbb None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:49.821276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-147ae9ec-68e4-4a73-bd0e-641071748bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:49.848408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7adb20-8fb9-4494-8161-4ea1c64ac10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:49.849900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7adb20-8fb9-4494-8161-4ea1c64ac10a service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:49.857993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:49.863571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 983/1981] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:49.932363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ae9ec-68e4-4a73-bd0e-641071748bbb None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:49.989008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c6ae1-d7db-4ce1-a8fb-139bbacbf9f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:49.989678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6ae1-d7db-4ce1-a8fb-139bbacbf9f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:49.989966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6ae1-d7db-4ce1-a8fb-139bbacbf9f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:49.990241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6ae1-d7db-4ce1-a8fb-139bbacbf9f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:49.992090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ce3c6ae1-d7db-4ce1-a8fb-139bbacbf9f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:50.060764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c6ae1-d7db-4ce1-a8fb-139bbacbf9f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:50.062351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c6ae1-d7db-4ce1-a8fb-139bbacbf9f6 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:50.072074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 999/1982] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:50.238114 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7adb20-8fb9-4494-8161-4ea1c64ac10a service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:50.239692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4e7adb20-8fb9-4494-8161-4ea1c64ac10a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:50.259064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7adb20-8fb9-4494-8161-4ea1c64ac10a service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:50.265027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:50.266149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:50.266504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:50.266854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] PATH_INFO: `/v3/projects/3fec777fa310493e804595af8adbf66c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:50.268935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fec777fa310493e804595af8adbf66c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:50.271002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:50.400924 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:50.417983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fec777fa310493e804595af8adbf66c', 'request_id': 'req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:50.544735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fec777fa310493e804595af8adbf66c', 'request_id': 'req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:50.552664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fec777fa310493e804595af8adbf66c', 'request_id': 'req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:50.565758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] The token cache is being invalidate because project 3fec777fa310493e804595af8adbf66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:50.566244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:50.567030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f5c350f1-30d2-4750-b9e5-6da6030c6ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:50.569339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 984/1983] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:50 2022] DELETE /identity/v3/projects/3fec777fa310493e804595af8adbf66c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:50.574855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c46a-aa9d-463f-8706-f04a16833a35 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:50.575145 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c46a-aa9d-463f-8706-f04a16833a35 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:50.575421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c46a-aa9d-463f-8706-f04a16833a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:50.604985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-e4e7c46a-aa9d-463f-8706-f04a16833a35 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:50.606387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e4e7c46a-aa9d-463f-8706-f04a16833a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:50.671755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1000/1984] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:50.680991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10df513-9697-4a2f-8fa4-4274bcc1ecc8 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:50.682864 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10df513-9697-4a2f-8fa4-4274bcc1ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:50.683158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10df513-9697-4a2f-8fa4-4274bcc1ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:50.713253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b10df513-9697-4a2f-8fa4-4274bcc1ecc8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:50.714491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b10df513-9697-4a2f-8fa4-4274bcc1ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:50.723097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 985/1985] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:50.727473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7c46a-aa9d-463f-8706-f04a16833a35 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:50.737761 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7c46a-aa9d-463f-8706-f04a16833a35 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:50.743534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39e463-2325-4eff-9767-2c5eb38a96f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:50.744198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39e463-2325-4eff-9767-2c5eb38a96f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:50.745152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39e463-2325-4eff-9767-2c5eb38a96f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:50.745438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39e463-2325-4eff-9767-2c5eb38a96f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:50.746266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39e463-2325-4eff-9767-2c5eb38a96f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:50.746570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39e463-2325-4eff-9767-2c5eb38a96f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:50.748183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39e463-2325-4eff-9767-2c5eb38a96f7 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:50.760080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1001/1986] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:46:50.764584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10df513-9697-4a2f-8fa4-4274bcc1ecc8 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:50.773689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10df513-9697-4a2f-8fa4-4274bcc1ecc8 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:50.780096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9bdbd-0e16-4440-9a0f-edc29f1de4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:50.782403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9bdbd-0e16-4440-9a0f-edc29f1de4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:50.782403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9bdbd-0e16-4440-9a0f-edc29f1de4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:50.782403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9bdbd-0e16-4440-9a0f-edc29f1de4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:50.782403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9bdbd-0e16-4440-9a0f-edc29f1de4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:50.784066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9bdbd-0e16-4440-9a0f-edc29f1de4c2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:50.896569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 986/1987] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:50 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:50.897883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39e463-2325-4eff-9767-2c5eb38a96f7 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:50.907715 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39e463-2325-4eff-9767-2c5eb38a96f7 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:50.964582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f1b62-fb39-46d1-95c2-8c6bd466d6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:50.965262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f1b62-fb39-46d1-95c2-8c6bd466d6df admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:50.965603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f1b62-fb39-46d1-95c2-8c6bd466d6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:50.965940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f1b62-fb39-46d1-95c2-8c6bd466d6df admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:50.966583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f1b62-fb39-46d1-95c2-8c6bd466d6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:50.968586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f1b62-fb39-46d1-95c2-8c6bd466d6df admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:51.052962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1002/1988] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:50 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:51.057470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9bdbd-0e16-4440-9a0f-edc29f1de4c2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:51.068411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9bdbd-0e16-4440-9a0f-edc29f1de4c2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:51.074313 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4d1e2-439a-4af8-aa58-44c77fc82df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:51.075050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d1e2-439a-4af8-aa58-44c77fc82df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.075400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d1e2-439a-4af8-aa58-44c77fc82df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.075719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d1e2-439a-4af8-aa58-44c77fc82df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:51.076484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4d1e2-439a-4af8-aa58-44c77fc82df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:51.078378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4d1e2-439a-4af8-aa58-44c77fc82df9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:51.093643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 987/1989] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:51.097854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f1b62-fb39-46d1-95c2-8c6bd466d6df admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:51.107918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f1b62-fb39-46d1-95c2-8c6bd466d6df admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:51.112729 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2d9bb-8719-4f4e-aaff-be6b17fd7a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:51.113393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2d9bb-8719-4f4e-aaff-be6b17fd7a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.113681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2d9bb-8719-4f4e-aaff-be6b17fd7a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.115619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2d9bb-8719-4f4e-aaff-be6b17fd7a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:51.115619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2d9bb-8719-4f4e-aaff-be6b17fd7a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:51.116717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2d9bb-8719-4f4e-aaff-be6b17fd7a97 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:51.127939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1003/1990] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:51.132634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4d1e2-439a-4af8-aa58-44c77fc82df9 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:51.143326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4d1e2-439a-4af8-aa58-44c77fc82df9 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:51.148056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce12071-cb49-4422-be3d-7a56d11ecc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:51.148976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12071-cb49-4422-be3d-7a56d11ecc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.149259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12071-cb49-4422-be3d-7a56d11ecc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.149557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12071-cb49-4422-be3d-7a56d11ecc8f admin admin] PATH_INFO: `/v3/projects/a9f2e1cd737a4910b2701bfee4b2f720/users/2676f3735cbc4a15aceabde48b02c39b/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:51.164281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce12071-cb49-4422-be3d-7a56d11ecc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f2e1cd737a4910b2701bfee4b2f720, user_id=2676f3735cbc4a15aceabde48b02c39b, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:51.167049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce12071-cb49-4422-be3d-7a56d11ecc8f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:51.225739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 988/1991] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:51 2022] PUT /identity/v3/projects/a9f2e1cd737a4910b2701bfee4b2f720/users/2676f3735cbc4a15aceabde48b02c39b/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:51.236591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012760-e13a-4fbf-8f87-f8ad5d1abf2e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.236914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012760-e13a-4fbf-8f87-f8ad5d1abf2e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.237199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012760-e13a-4fbf-8f87-f8ad5d1abf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:51.266815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-9f012760-e13a-4fbf-8f87-f8ad5d1abf2e None None] MFA Rules not processed for user `2676f3735cbc4a15aceabde48b02c39b`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:51.268366 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9f012760-e13a-4fbf-8f87-f8ad5d1abf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:51.286617 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af29be5-8faa-4856-a67a-cb512e610181 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.287142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af29be5-8faa-4856-a67a-cb512e610181 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.290064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af29be5-8faa-4856-a67a-cb512e610181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:51.328018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-3af29be5-8faa-4856-a67a-cb512e610181 None None] MFA Rules not processed for user `802e57d8a98841e5aefb9ae4858513b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:51.329569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3af29be5-8faa-4856-a67a-cb512e610181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:51.393349 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1004/1992] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:51.397802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f012760-e13a-4fbf-8f87-f8ad5d1abf2e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:51.420459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 989/1993] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:51.421855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af29be5-8faa-4856-a67a-cb512e610181 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:51.423602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3af29be5-8faa-4856-a67a-cb512e610181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:51.490394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f012760-e13a-4fbf-8f87-f8ad5d1abf2e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:51.495597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b7861-5693-4770-83b5-6319025bd5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:51.496383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b7861-5693-4770-83b5-6319025bd5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.496674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b7861-5693-4770-83b5-6319025bd5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.496969 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b7861-5693-4770-83b5-6319025bd5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:51.497789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b7861-5693-4770-83b5-6319025bd5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:51.499596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b7861-5693-4770-83b5-6319025bd5f6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:51.503317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af29be5-8faa-4856-a67a-cb512e610181 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:51.510532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c9cbf-b775-4611-9af5-3cc6ddd464ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:51.511988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c9cbf-b775-4611-9af5-3cc6ddd464ec admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.512458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c9cbf-b775-4611-9af5-3cc6ddd464ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.512750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c9cbf-b775-4611-9af5-3cc6ddd464ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:51.513487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c9cbf-b775-4611-9af5-3cc6ddd464ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:51.516982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c9cbf-b775-4611-9af5-3cc6ddd464ec admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:51.534144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:51.609296 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1005/1994] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:51 2022] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:51.615149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b7861-5693-4770-83b5-6319025bd5f6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:51.625111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:51.633950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 990/1995] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:51 2022] POST /identity/v3/projects => generated 405 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:51.640388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c9cbf-b775-4611-9af5-3cc6ddd464ec admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:51.700159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b7861-5693-4770-83b5-6319025bd5f6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:51.734290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c9cbf-b775-4611-9af5-3cc6ddd464ec admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:51.739633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92604c57-8ba4-4d48-920f-4ddc77ebee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:51.740924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92604c57-8ba4-4d48-920f-4ddc77ebee7d admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.740924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92604c57-8ba4-4d48-920f-4ddc77ebee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.741116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92604c57-8ba4-4d48-920f-4ddc77ebee7d admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:51.741909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92604c57-8ba4-4d48-920f-4ddc77ebee7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:51.743975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92604c57-8ba4-4d48-920f-4ddc77ebee7d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:51.791280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d38ad1-7355-409d-a11c-60f45248a3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:51.792676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d38ad1-7355-409d-a11c-60f45248a3cc admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.793476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d38ad1-7355-409d-a11c-60f45248a3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.793476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d38ad1-7355-409d-a11c-60f45248a3cc admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:51.793951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d38ad1-7355-409d-a11c-60f45248a3cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:51.796165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d38ad1-7355-409d-a11c-60f45248a3cc admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:51.929408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 991/1996] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:51 2022] POST /identity/v3/users => generated 309 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:51.929408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92604c57-8ba4-4d48-920f-4ddc77ebee7d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:51.929408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-92604c57-8ba4-4d48-920f-4ddc77ebee7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:51.978991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1006/1997] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:51 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:51.980131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d38ad1-7355-409d-a11c-60f45248a3cc admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:51.993058 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d38ad1-7355-409d-a11c-60f45248a3cc admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:51.997966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92604c57-8ba4-4d48-920f-4ddc77ebee7d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:51.998097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead9b1-bf80-4d51-9dd5-9075d4816408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:51.998760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead9b1-bf80-4d51-9dd5-9075d4816408 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:51.999181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead9b1-bf80-4d51-9dd5-9075d4816408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:51.999470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead9b1-bf80-4d51-9dd5-9075d4816408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.000204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead9b1-bf80-4d51-9dd5-9075d4816408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.001887 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3baebd-78ea-4a05-907d-c673226b64ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:52.002054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead9b1-bf80-4d51-9dd5-9075d4816408 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.002594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3baebd-78ea-4a05-907d-c673226b64ea service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.003026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3baebd-78ea-4a05-907d-c673226b64ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.003262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3baebd-78ea-4a05-907d-c673226b64ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.005897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-be3baebd-78ea-4a05-907d-c673226b64ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:52.018486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1007/1998] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:52.019486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead9b1-bf80-4d51-9dd5-9075d4816408 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:52.033639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead9b1-bf80-4d51-9dd5-9075d4816408 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:52.038975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978123c6-1b52-40b5-a035-523b5a44b958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:52.039648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978123c6-1b52-40b5-a035-523b5a44b958 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.039935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978123c6-1b52-40b5-a035-523b5a44b958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.040213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978123c6-1b52-40b5-a035-523b5a44b958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.040975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978123c6-1b52-40b5-a035-523b5a44b958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.042832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978123c6-1b52-40b5-a035-523b5a44b958 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.053798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1008/1999] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:52.054878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978123c6-1b52-40b5-a035-523b5a44b958 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:52.065516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978123c6-1b52-40b5-a035-523b5a44b958 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:52.070375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3a064-4398-4518-ae98-d302ba5926e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:52.071257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3a064-4398-4518-ae98-d302ba5926e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.073298 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3a064-4398-4518-ae98-d302ba5926e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.073298 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3a064-4398-4518-ae98-d302ba5926e2 admin admin] PATH_INFO: `/v3/projects/3b60513d0e54449f9138df9b4c581388/users/ed7e3845388f4f99a1f3ac384a12016b/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.085991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3baebd-78ea-4a05-907d-c673226b64ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.087450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3baebd-78ea-4a05-907d-c673226b64ea service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.089247 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3a064-4398-4518-ae98-d302ba5926e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b60513d0e54449f9138df9b4c581388, user_id=ed7e3845388f4f99a1f3ac384a12016b, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.092032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3a064-4398-4518-ae98-d302ba5926e2 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.099247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 992/2000] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:52.099839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3baebd-78ea-4a05-907d-c673226b64ea service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:52.110930 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3baebd-78ea-4a05-907d-c673226b64ea service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:52.117964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c11ff-d2a8-4f1b-a17d-205ed4773f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:52.118941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c11ff-d2a8-4f1b-a17d-205ed4773f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.119820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c11ff-d2a8-4f1b-a17d-205ed4773f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.120327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c11ff-d2a8-4f1b-a17d-205ed4773f05 admin admin] PATH_INFO: `/v3/projects/fe4b53826905466da2d3eb3e056e9227/users/6d92425d8b3145efa656bc228f6a81a6/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.138192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c11ff-d2a8-4f1b-a17d-205ed4773f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4b53826905466da2d3eb3e056e9227, user_id=6d92425d8b3145efa656bc228f6a81a6, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.141139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c11ff-d2a8-4f1b-a17d-205ed4773f05 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.160990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1009/2001] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:52 2022] PUT /identity/v3/projects/3b60513d0e54449f9138df9b4c581388/users/ed7e3845388f4f99a1f3ac384a12016b/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:52.164871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3a064-4398-4518-ae98-d302ba5926e2 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:52.236942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3a064-4398-4518-ae98-d302ba5926e2 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:52.241754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f429-4fb3-4974-8585-b5cbbc6093b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:52.242428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f429-4fb3-4974-8585-b5cbbc6093b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.242711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f429-4fb3-4974-8585-b5cbbc6093b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.243041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f429-4fb3-4974-8585-b5cbbc6093b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.243828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6f429-4fb3-4974-8585-b5cbbc6093b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.245974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6f429-4fb3-4974-8585-b5cbbc6093b6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.255968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1010/2002] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:52.260796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 993/2003] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:52 2022] PUT /identity/v3/projects/fe4b53826905466da2d3eb3e056e9227/users/6d92425d8b3145efa656bc228f6a81a6/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:52.266736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f429-4fb3-4974-8585-b5cbbc6093b6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:52.267907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c11ff-d2a8-4f1b-a17d-205ed4773f05 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:52.277201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f429-4fb3-4974-8585-b5cbbc6093b6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:52.336110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c11ff-d2a8-4f1b-a17d-205ed4773f05 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:52.338200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7985c-4ebf-4f87-807a-6881387ba073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:52.339376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7985c-4ebf-4f87-807a-6881387ba073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.339669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7985c-4ebf-4f87-807a-6881387ba073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.340173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7985c-4ebf-4f87-807a-6881387ba073 admin admin] PATH_INFO: `/v3/projects/3b60513d0e54449f9138df9b4c581388/users/ed7e3845388f4f99a1f3ac384a12016b/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.342467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555547-4684-4b5c-90d0-fb112ec4dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:52.343213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555547-4684-4b5c-90d0-fb112ec4dd76 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.343538 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555547-4684-4b5c-90d0-fb112ec4dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.343663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7985c-4ebf-4f87-807a-6881387ba073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b60513d0e54449f9138df9b4c581388, user_id=ed7e3845388f4f99a1f3ac384a12016b, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.343880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555547-4684-4b5c-90d0-fb112ec4dd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.344653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4555547-4684-4b5c-90d0-fb112ec4dd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.346288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7985c-4ebf-4f87-807a-6881387ba073 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.346903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4555547-4684-4b5c-90d0-fb112ec4dd76 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.359085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1011/2004] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:52 2022] PUT /identity/v3/projects/3b60513d0e54449f9138df9b4c581388/users/ed7e3845388f4f99a1f3ac384a12016b/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:52.367744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 994/2005] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:52.368869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7985c-4ebf-4f87-807a-6881387ba073 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:52.438645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7985c-4ebf-4f87-807a-6881387ba073 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:52.443595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b8825-fca3-4633-8b80-e20875abcca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:52.444514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b8825-fca3-4633-8b80-e20875abcca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.444797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b8825-fca3-4633-8b80-e20875abcca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.445074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b8825-fca3-4633-8b80-e20875abcca0 admin admin] PATH_INFO: `/v3/projects/fe4b53826905466da2d3eb3e056e9227/users/6d92425d8b3145efa656bc228f6a81a6/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.447047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b8825-fca3-4633-8b80-e20875abcca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4b53826905466da2d3eb3e056e9227, user_id=6d92425d8b3145efa656bc228f6a81a6, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.449829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b8825-fca3-4633-8b80-e20875abcca0 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.460335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1012/2006] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:52 2022] PUT /identity/v3/projects/fe4b53826905466da2d3eb3e056e9227/users/6d92425d8b3145efa656bc228f6a81a6/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:52.470635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090d28-6e9f-468b-abef-9caca547154d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.470928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090d28-6e9f-468b-abef-9caca547154d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.471206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090d28-6e9f-468b-abef-9caca547154d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.499847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-f0090d28-6e9f-468b-abef-9caca547154d None None] MFA Rules not processed for user `6d92425d8b3145efa656bc228f6a81a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:52.501060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f0090d28-6e9f-468b-abef-9caca547154d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:52.575250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 995/2007] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:52.586959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b8825-fca3-4633-8b80-e20875abcca0 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:52.650656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b8825-fca3-4633-8b80-e20875abcca0 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:52.655415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f9221-8036-4d8b-9d7a-5bf395076dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:52.656156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f9221-8036-4d8b-9d7a-5bf395076dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:52.656491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f9221-8036-4d8b-9d7a-5bf395076dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:52.656773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f9221-8036-4d8b-9d7a-5bf395076dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:52.667038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f9221-8036-4d8b-9d7a-5bf395076dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:52.668602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f9221-8036-4d8b-9d7a-5bf395076dc2 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:52.678887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1013/2008] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:52.962103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:53.001862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090d28-6e9f-468b-abef-9caca547154d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:53.004575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f9221-8036-4d8b-9d7a-5bf395076dc2 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:53.006556 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-de9f9221-8036-4d8b-9d7a-5bf395076dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:53.012391 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090d28-6e9f-468b-abef-9caca547154d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:53.025676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa811dd-d4ac-42ca-a611-7b2d98db23fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:53.026858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa811dd-d4ac-42ca-a611-7b2d98db23fa service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:53.027145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa811dd-d4ac-42ca-a611-7b2d98db23fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:53.028617 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa811dd-d4ac-42ca-a611-7b2d98db23fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:53.092560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f9221-8036-4d8b-9d7a-5bf395076dc2 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:53.097985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:53.098939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:53.099301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:53.099680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] PATH_INFO: `/v3/users/77b6e3d97c4d4c8aa514bd2c20048142` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:53.101024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b6e3d97c4d4c8aa514bd2c20048142)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:53.103059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:53.105777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa811dd-d4ac-42ca-a611-7b2d98db23fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:53.107389 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa811dd-d4ac-42ca-a611-7b2d98db23fa service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:53.118891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 996/2009] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:53.265915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b6e3d97c4d4c8aa514bd2c20048142'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:53.337915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b6e3d97c4d4c8aa514bd2c20048142'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:53.338819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b6e3d97c4d4c8aa514bd2c20048142'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:53.339421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b6e3d97c4d4c8aa514bd2c20048142'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:53.347157 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b6e3d97c4d4c8aa514bd2c20048142'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:53.365423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1014/2010] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:53 2022] DELETE /identity/v3/users/77b6e3d97c4d4c8aa514bd2c20048142 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:53.555192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:53.708112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa811dd-d4ac-42ca-a611-7b2d98db23fa service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:53.721644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa811dd-d4ac-42ca-a611-7b2d98db23fa service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:53.781401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:53.782263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:53.782544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:53.782848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] PATH_INFO: `/v3/projects/189a51676510482c9c44e00646f4ba38` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:53.783990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189a51676510482c9c44e00646f4ba38)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:53.785935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:53.924945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189a51676510482c9c44e00646f4ba38', 'request_id': 'req-c53b77a4-6b05-47be-b615-d4f725bb54e2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:53.994924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189a51676510482c9c44e00646f4ba38', 'request_id': 'req-c53b77a4-6b05-47be-b615-d4f725bb54e2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:54.003059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189a51676510482c9c44e00646f4ba38', 'request_id': 'req-c53b77a4-6b05-47be-b615-d4f725bb54e2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:54.019890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] The token cache is being invalidate because project 189a51676510482c9c44e00646f4ba38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:54.020216 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:54.021017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c53b77a4-6b05-47be-b615-d4f725bb54e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:54.022585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 997/2011] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:53 2022] DELETE /identity/v3/projects/189a51676510482c9c44e00646f4ba38 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:54.027383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:54.028927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:54.042487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c3e42-beb5-4b9b-bdc3-eac56bdd9cb6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:54.110699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c72b0-2211-4b0d-abb9-7c6ebb9af00f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:54.111546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c72b0-2211-4b0d-abb9-7c6ebb9af00f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:54.112036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c72b0-2211-4b0d-abb9-7c6ebb9af00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:54.124611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:54.124611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:54.126790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:54.127163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] PATH_INFO: `/v3/users/8366da7cbc784b9d870c916a7538fb23` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:54.129959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8366da7cbc784b9d870c916a7538fb23)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:54.135332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:54.171919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-cb4c72b0-2211-4b0d-abb9-7c6ebb9af00f None None] MFA Rules not processed for user `ed7e3845388f4f99a1f3ac384a12016b`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:54.173556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cb4c72b0-2211-4b0d-abb9-7c6ebb9af00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:54.260440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 998/2012] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:54.386041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8366da7cbc784b9d870c916a7538fb23'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:54.486702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8366da7cbc784b9d870c916a7538fb23'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:54.487242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8366da7cbc784b9d870c916a7538fb23'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:54.487843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8366da7cbc784b9d870c916a7538fb23'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:54.495711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce5d3859-57f1-4505-b222-16e212857dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8366da7cbc784b9d870c916a7538fb23'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:54.514156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1015/2013] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:54 2022] DELETE /identity/v3/users/8366da7cbc784b9d870c916a7538fb23 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:54.831718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c72b0-2211-4b0d-abb9-7c6ebb9af00f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:54.833722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cb4c72b0-2211-4b0d-abb9-7c6ebb9af00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:54.851909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c72b0-2211-4b0d-abb9-7c6ebb9af00f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:54.912700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:54.913622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:54.913907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:54.914185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] PATH_INFO: `/v3/projects/2c1fd62621ec47528060092afc95e5cf` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:54.915380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1fd62621ec47528060092afc95e5cf)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:54.917670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:55.019567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae539-09cc-4389-9272-ada2f37aa45a None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.019885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae539-09cc-4389-9272-ada2f37aa45a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.020144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae539-09cc-4389-9272-ada2f37aa45a None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.022086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1016/2014] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:46:55.046648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1fd62621ec47528060092afc95e5cf', 'request_id': 'req-119e6501-42d1-4886-a6ac-56546b5efb3c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:55.050873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76356a57-cbf6-475b-be04-79e3be76e5cd None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.052437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76356a57-cbf6-475b-be04-79e3be76e5cd None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.052992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76356a57-cbf6-475b-be04-79e3be76e5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.081591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-76356a57-cbf6-475b-be04-79e3be76e5cd None None] MFA Rules not processed for user `a5997b3965f44d6fbdf55cccdfc52ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:55.082820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-76356a57-cbf6-475b-be04-79e3be76e5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:55.145713 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1017/2015] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:55.157116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76356a57-cbf6-475b-be04-79e3be76e5cd None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:55.158432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-76356a57-cbf6-475b-be04-79e3be76e5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:55.171586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76356a57-cbf6-475b-be04-79e3be76e5cd None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:55.176762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459bc97-cabc-418f-bd96-8bfd4dcac0e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:55.177431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459bc97-cabc-418f-bd96-8bfd4dcac0e2 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.177717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459bc97-cabc-418f-bd96-8bfd4dcac0e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.177996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459bc97-cabc-418f-bd96-8bfd4dcac0e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.187056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459bc97-cabc-418f-bd96-8bfd4dcac0e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:55.188794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459bc97-cabc-418f-bd96-8bfd4dcac0e2 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:55.200662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1018/2016] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:55.209362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1fd62621ec47528060092afc95e5cf', 'request_id': 'req-119e6501-42d1-4886-a6ac-56546b5efb3c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:55.217493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1fd62621ec47528060092afc95e5cf', 'request_id': 'req-119e6501-42d1-4886-a6ac-56546b5efb3c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:55.230839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] The token cache is being invalidate because project 2c1fd62621ec47528060092afc95e5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:55.230839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:55.231444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-119e6501-42d1-4886-a6ac-56546b5efb3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:55.233322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 999/2017] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:54 2022] DELETE /identity/v3/projects/2c1fd62621ec47528060092afc95e5cf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:55.238539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f152e1-095f-431f-a4ae-a468cdc4c8af None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.238539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f152e1-095f-431f-a4ae-a468cdc4c8af None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.240147 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f152e1-095f-431f-a4ae-a468cdc4c8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.260114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:55.264654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-f9f152e1-095f-431f-a4ae-a468cdc4c8af None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:55.265889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f9f152e1-095f-431f-a4ae-a468cdc4c8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:55.303794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:55.333675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1019/2018] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:55.342424 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10831be4-6ab8-44a1-b6e9-8b8f0bffa681 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.342803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10831be4-6ab8-44a1-b6e9-8b8f0bffa681 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.343154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10831be4-6ab8-44a1-b6e9-8b8f0bffa681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.372830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-10831be4-6ab8-44a1-b6e9-8b8f0bffa681 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:55.374435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-10831be4-6ab8-44a1-b6e9-8b8f0bffa681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:55.383263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1000/2019] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:55.388150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f152e1-095f-431f-a4ae-a468cdc4c8af None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:55.401581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f152e1-095f-431f-a4ae-a468cdc4c8af None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:55.406039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c921c-eea1-4e3c-8c3d-de93da8aab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:55.406829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c921c-eea1-4e3c-8c3d-de93da8aab43 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.407117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c921c-eea1-4e3c-8c3d-de93da8aab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.407396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c921c-eea1-4e3c-8c3d-de93da8aab43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.408153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c921c-eea1-4e3c-8c3d-de93da8aab43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:55.408489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c921c-eea1-4e3c-8c3d-de93da8aab43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:55.410097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c921c-eea1-4e3c-8c3d-de93da8aab43 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:55.424131 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1020/2020] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:46:55.428334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10831be4-6ab8-44a1-b6e9-8b8f0bffa681 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:55.438642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10831be4-6ab8-44a1-b6e9-8b8f0bffa681 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:55.443477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ec17-8928-40a2-b89f-fd17e809c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:55.444246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ec17-8928-40a2-b89f-fd17e809c573 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.444610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ec17-8928-40a2-b89f-fd17e809c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.444953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ec17-8928-40a2-b89f-fd17e809c573 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.445709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ec17-8928-40a2-b89f-fd17e809c573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:55.448519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ec17-8928-40a2-b89f-fd17e809c573 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:55.566739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1001/2021] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:55 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:55.567892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c921c-eea1-4e3c-8c3d-de93da8aab43 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:55.579582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c921c-eea1-4e3c-8c3d-de93da8aab43 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:55.639996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1d166-3824-44b1-8306-917542d4da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:55.640712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1d166-3824-44b1-8306-917542d4da4b admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.640999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1d166-3824-44b1-8306-917542d4da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.641278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1d166-3824-44b1-8306-917542d4da4b admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.641974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1d166-3824-44b1-8306-917542d4da4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:55.643916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1d166-3824-44b1-8306-917542d4da4b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:55.763384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1021/2022] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:55 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:55.767554 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ec17-8928-40a2-b89f-fd17e809c573 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:55.778774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ec17-8928-40a2-b89f-fd17e809c573 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:55.783539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079096-eb56-4b9c-a6f4-602befeeadf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:55.784228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079096-eb56-4b9c-a6f4-602befeeadf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.784559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079096-eb56-4b9c-a6f4-602befeeadf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.784834 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079096-eb56-4b9c-a6f4-602befeeadf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.785562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da079096-eb56-4b9c-a6f4-602befeeadf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:55.787179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da079096-eb56-4b9c-a6f4-602befeeadf9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:55.799195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1002/2023] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:55.803340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1d166-3824-44b1-8306-917542d4da4b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:55.814526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1d166-3824-44b1-8306-917542d4da4b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:55.819244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788fc19-8fc5-413e-bd24-39272ecb3534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:55.819930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788fc19-8fc5-413e-bd24-39272ecb3534 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.820199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788fc19-8fc5-413e-bd24-39272ecb3534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.820505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788fc19-8fc5-413e-bd24-39272ecb3534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.821231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788fc19-8fc5-413e-bd24-39272ecb3534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:55.823761 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788fc19-8fc5-413e-bd24-39272ecb3534 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:55.837883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1022/2024] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:55.839232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079096-eb56-4b9c-a6f4-602befeeadf9 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:55.849064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079096-eb56-4b9c-a6f4-602befeeadf9 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:55.853613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c360fe-9da5-474d-994f-e4e2b64e111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:55.854522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c360fe-9da5-474d-994f-e4e2b64e111f admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.854795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c360fe-9da5-474d-994f-e4e2b64e111f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.855063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c360fe-9da5-474d-994f-e4e2b64e111f admin admin] PATH_INFO: `/v3/projects/13f5566adafe47c2ad04f3279d1bd76a/users/639582f6e4db49adb163cc0ec279429c/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:55.869989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c360fe-9da5-474d-994f-e4e2b64e111f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f5566adafe47c2ad04f3279d1bd76a, user_id=639582f6e4db49adb163cc0ec279429c, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:55.872707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c360fe-9da5-474d-994f-e4e2b64e111f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:55.961070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1003/2025] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:55 2022] PUT /identity/v3/projects/13f5566adafe47c2ad04f3279d1bd76a/users/639582f6e4db49adb163cc0ec279429c/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:55.972651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7523f0-e050-46f8-b01e-a4bf391c1d67 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:55.973022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7523f0-e050-46f8-b01e-a4bf391c1d67 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:55.973314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7523f0-e050-46f8-b01e-a4bf391c1d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:56.002893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2d7523f0-e050-46f8-b01e-a4bf391c1d67 None None] MFA Rules not processed for user `639582f6e4db49adb163cc0ec279429c`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:56.004167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2d7523f0-e050-46f8-b01e-a4bf391c1d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:56.077423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c360fe-9da5-474d-994f-e4e2b64e111f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:56.079447 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1023/2026] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:56.086502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c3c360fe-9da5-474d-994f-e4e2b64e111f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:56.086783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7523f0-e050-46f8-b01e-a4bf391c1d67 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:56.088973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2d7523f0-e050-46f8-b01e-a4bf391c1d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:56.154207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7523f0-e050-46f8-b01e-a4bf391c1d67 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:56.157960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105eae-78b8-4ae6-86eb-5816e9ca2917 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9533e8371e64161a4c54eeab867a17e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:56.158645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105eae-78b8-4ae6-86eb-5816e9ca2917 service glance] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:56.158928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105eae-78b8-4ae6-86eb-5816e9ca2917 service glance] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:56.159201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105eae-78b8-4ae6-86eb-5816e9ca2917 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:56.168798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54105eae-78b8-4ae6-86eb-5816e9ca2917 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:56.170271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54105eae-78b8-4ae6-86eb-5816e9ca2917 service glance] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:56.180335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1024/2027] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:46:56.186893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c360fe-9da5-474d-994f-e4e2b64e111f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:56.191861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:56.193048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:56.193546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:56.194351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] PATH_INFO: `/v3/users/802e57d8a98841e5aefb9ae4858513b8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:56.195809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=802e57d8a98841e5aefb9ae4858513b8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:56.199388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:56.381888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802e57d8a98841e5aefb9ae4858513b8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:56.382566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802e57d8a98841e5aefb9ae4858513b8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:56.391185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802e57d8a98841e5aefb9ae4858513b8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:56.403539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802e57d8a98841e5aefb9ae4858513b8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:56.521159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802e57d8a98841e5aefb9ae4858513b8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:56.538876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1004/2028] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:56 2022] DELETE /identity/v3/users/802e57d8a98841e5aefb9ae4858513b8 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:56.721251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:56.761928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105eae-78b8-4ae6-86eb-5816e9ca2917 service glance] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:56.775096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105eae-78b8-4ae6-86eb-5816e9ca2917 service glance] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:56.790599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:56.842364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:56.843257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:56.843543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:56.843821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] PATH_INFO: `/v3/projects/7831483b838740f091328159bce769b1` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:56.845041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7831483b838740f091328159bce769b1)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:56.847014 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:56.978376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7831483b838740f091328159bce769b1', 'request_id': 'req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:56.984552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7831483b838740f091328159bce769b1', 'request_id': 'req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:57.052369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7831483b838740f091328159bce769b1', 'request_id': 'req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:57.065622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] The token cache is being invalidate because project 7831483b838740f091328159bce769b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:57.065915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:57.066560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:57.068172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1025/2029] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:56 2022] DELETE /identity/v3/projects/7831483b838740f091328159bce769b1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:57.072121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:57.073699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:57.090173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f091-0ee9-425f-8d4a-8b64b4f9d33c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:57.161171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:57.162055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:57.162341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:57.162620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] PATH_INFO: `/v3/users/ed7e3845388f4f99a1f3ac384a12016b` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:57.163828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7e3845388f4f99a1f3ac384a12016b)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:57.165858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:57.374142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7e3845388f4f99a1f3ac384a12016b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:57.374818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7e3845388f4f99a1f3ac384a12016b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:57.381636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7e3845388f4f99a1f3ac384a12016b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:57.393334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7e3845388f4f99a1f3ac384a12016b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:57.457868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0f2cd752-b4bf-49bb-ba13-29c908aa6da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7e3845388f4f99a1f3ac384a12016b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:57.465641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1005/2030] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:57 2022] DELETE /identity/v3/users/ed7e3845388f4f99a1f3ac384a12016b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:57.780239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:57.781920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:57.809120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a2e6f-e1ac-4240-96b3-57fb57215e29 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:57.877474 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:57.878372 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:57.878659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:57.878940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] PATH_INFO: `/v3/projects/3b60513d0e54449f9138df9b4c581388` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:57.880133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b60513d0e54449f9138df9b4c581388)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:57.882099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:58.036003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b60513d0e54449f9138df9b4c581388', 'request_id': 'req-e93959c7-7f05-4cd8-a718-7f4e665afc07'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:58.041551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b60513d0e54449f9138df9b4c581388', 'request_id': 'req-e93959c7-7f05-4cd8-a718-7f4e665afc07'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:58.161384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b60513d0e54449f9138df9b4c581388', 'request_id': 'req-e93959c7-7f05-4cd8-a718-7f4e665afc07'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:58.178086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] The token cache is being invalidate because project 3b60513d0e54449f9138df9b4c581388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:46:58.178086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:58.178086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e93959c7-7f05-4cd8-a718-7f4e665afc07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:58.179734 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1026/2031] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:57 2022] DELETE /identity/v3/projects/3b60513d0e54449f9138df9b4c581388 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:58.185511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a17b4-92bc-490c-99c5-655638d743f4 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.185998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a17b4-92bc-490c-99c5-655638d743f4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.186103 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a17b4-92bc-490c-99c5-655638d743f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.205381 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-340a17b4-92bc-490c-99c5-655638d743f4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:58.206638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-340a17b4-92bc-490c-99c5-655638d743f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:58.235379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:58.268333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1006/2032] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:58.276279 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82967723-2143-4242-bc7f-92b26a704a55 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.276663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82967723-2143-4242-bc7f-92b26a704a55 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.277363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82967723-2143-4242-bc7f-92b26a704a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.296472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-82967723-2143-4242-bc7f-92b26a704a55 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:58.298511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-82967723-2143-4242-bc7f-92b26a704a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:58.317713 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1027/2033] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:58.322434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a17b4-92bc-490c-99c5-655638d743f4 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:58.333330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a17b4-92bc-490c-99c5-655638d743f4 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:58.338210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211858d-e9a3-432f-9a0d-80b22bec1b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:58.339425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211858d-e9a3-432f-9a0d-80b22bec1b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.339697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211858d-e9a3-432f-9a0d-80b22bec1b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.339972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211858d-e9a3-432f-9a0d-80b22bec1b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.340740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211858d-e9a3-432f-9a0d-80b22bec1b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:46:58.341038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211858d-e9a3-432f-9a0d-80b22bec1b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:58.342756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211858d-e9a3-432f-9a0d-80b22bec1b90 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:58.355812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1007/2034] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:46:58.360547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82967723-2143-4242-bc7f-92b26a704a55 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:58.370737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82967723-2143-4242-bc7f-92b26a704a55 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:58.376117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d883c22-f636-4c17-87a1-d2e5d3b38e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:58.376832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d883c22-f636-4c17-87a1-d2e5d3b38e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.377142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d883c22-f636-4c17-87a1-d2e5d3b38e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.377418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d883c22-f636-4c17-87a1-d2e5d3b38e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.378116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d883c22-f636-4c17-87a1-d2e5d3b38e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:58.380036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d883c22-f636-4c17-87a1-d2e5d3b38e76 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:58.506081 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1028/2035] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:58 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:58.510171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211858d-e9a3-432f-9a0d-80b22bec1b90 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:58.520470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211858d-e9a3-432f-9a0d-80b22bec1b90 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:58.578314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc08be6-8923-42f2-9d30-4eb5c922253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:58.578997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc08be6-8923-42f2-9d30-4eb5c922253f admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.579284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc08be6-8923-42f2-9d30-4eb5c922253f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.579565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc08be6-8923-42f2-9d30-4eb5c922253f admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.580266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc08be6-8923-42f2-9d30-4eb5c922253f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:58.582229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc08be6-8923-42f2-9d30-4eb5c922253f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:58.629895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:58.693148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1008/2036] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:58 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:58.697728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d883c22-f636-4c17-87a1-d2e5d3b38e76 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:58.711412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d883c22-f636-4c17-87a1-d2e5d3b38e76 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:58.717565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d7e6-2b72-491a-ab1e-77f1d60c2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:58.718232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d7e6-2b72-491a-ab1e-77f1d60c2547 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.720125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d7e6-2b72-491a-ab1e-77f1d60c2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.720537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d7e6-2b72-491a-ab1e-77f1d60c2547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.721298 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63d7e6-2b72-491a-ab1e-77f1d60c2547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:58.722968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63d7e6-2b72-491a-ab1e-77f1d60c2547 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:58.739556 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1029/2037] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:58.740415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc08be6-8923-42f2-9d30-4eb5c922253f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:58.750813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc08be6-8923-42f2-9d30-4eb5c922253f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:58.756517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55fc72-e1f4-48c5-9829-ffdda748247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:58.757593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55fc72-e1f4-48c5-9829-ffdda748247f admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.757994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55fc72-e1f4-48c5-9829-ffdda748247f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.758478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55fc72-e1f4-48c5-9829-ffdda748247f admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.759458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55fc72-e1f4-48c5-9829-ffdda748247f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:58.761877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55fc72-e1f4-48c5-9829-ffdda748247f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:58.775203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1009/2038] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:58.780550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d7e6-2b72-491a-ab1e-77f1d60c2547 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:58.790962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d7e6-2b72-491a-ab1e-77f1d60c2547 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:58.796784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3c41e-8c4b-4fec-a001-71d118fc6ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:58.797669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3c41e-8c4b-4fec-a001-71d118fc6ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.797947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3c41e-8c4b-4fec-a001-71d118fc6ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.798216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3c41e-8c4b-4fec-a001-71d118fc6ecf admin admin] PATH_INFO: `/v3/projects/d727216050fa49bd87827ee7f5bb33de/users/ed08cb45810b45c89cca28773acaad0b/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.813952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3c41e-8c4b-4fec-a001-71d118fc6ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d727216050fa49bd87827ee7f5bb33de, user_id=ed08cb45810b45c89cca28773acaad0b, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:58.816625 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3c41e-8c4b-4fec-a001-71d118fc6ecf admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:58.833172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55fc72-e1f4-48c5-9829-ffdda748247f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:58.837671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-be55fc72-e1f4-48c5-9829-ffdda748247f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:58.852034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55fc72-e1f4-48c5-9829-ffdda748247f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:58.857650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:58.858526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.858811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.859108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] PATH_INFO: `/v3/users/cc6f80a9e37d483d9eb90b1834f115c3` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.860503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6f80a9e37d483d9eb90b1834f115c3)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:58.862510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:58.881614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1030/2039] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:58 2022] PUT /identity/v3/projects/d727216050fa49bd87827ee7f5bb33de/users/ed08cb45810b45c89cca28773acaad0b/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:46:58.893405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee34f-a950-4a95-a1bd-fed8b23db2f7 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:58.893702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee34f-a950-4a95-a1bd-fed8b23db2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:58.893985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee34f-a950-4a95-a1bd-fed8b23db2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:58.923930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a61ee34f-a950-4a95-a1bd-fed8b23db2f7 None None] MFA Rules not processed for user `ed08cb45810b45c89cca28773acaad0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:58.925242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a61ee34f-a950-4a95-a1bd-fed8b23db2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:58.999298 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1031/2040] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:59.005668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ee34f-a950-4a95-a1bd-fed8b23db2f7 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:59.070175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ee34f-a950-4a95-a1bd-fed8b23db2f7 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:59.075426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e5a60-ebb8-4157-a863-41922f18296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:59.076076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e5a60-ebb8-4157-a863-41922f18296d admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:59.076384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e5a60-ebb8-4157-a863-41922f18296d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:59.076661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e5a60-ebb8-4157-a863-41922f18296d admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:59.077338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e5a60-ebb8-4157-a863-41922f18296d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:59.079517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e5a60-ebb8-4157-a863-41922f18296d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:59.100757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6f80a9e37d483d9eb90b1834f115c3'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:59.101974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6f80a9e37d483d9eb90b1834f115c3'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:59.110271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6f80a9e37d483d9eb90b1834f115c3'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:59.135125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6f80a9e37d483d9eb90b1834f115c3'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:59.248570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1032/2041] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:46:59 2022] POST /identity/v3/projects => generated 363 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:46:59.252722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e5a60-ebb8-4157-a863-41922f18296d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:59.303684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f63c535f-5b41-4918-aff3-ac766038e718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6f80a9e37d483d9eb90b1834f115c3'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:46:59.311094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1010/2042] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:46:58 2022] DELETE /identity/v3/users/cc6f80a9e37d483d9eb90b1834f115c3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:59.315773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa894ba6-1599-41d0-95c4-e65f0d13ba65 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:59.316063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa894ba6-1599-41d0-95c4-e65f0d13ba65 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:59.316371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa894ba6-1599-41d0-95c4-e65f0d13ba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:59.317769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e5a60-ebb8-4157-a863-41922f18296d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:59.334686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-aa894ba6-1599-41d0-95c4-e65f0d13ba65 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:59.335891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-aa894ba6-1599-41d0-95c4-e65f0d13ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:59.378519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898b7e-2cce-4c97-89a8-4ca549060921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:59.379335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898b7e-2cce-4c97-89a8-4ca549060921 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:59.379624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898b7e-2cce-4c97-89a8-4ca549060921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:59.379920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898b7e-2cce-4c97-89a8-4ca549060921 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:59.380643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8898b7e-2cce-4c97-89a8-4ca549060921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:59.382703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8898b7e-2cce-4c97-89a8-4ca549060921 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:59.402868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1011/2043] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:46:59.413900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa894ba6-1599-41d0-95c4-e65f0d13ba65 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:59.415356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-aa894ba6-1599-41d0-95c4-e65f0d13ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:59.474176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa894ba6-1599-41d0-95c4-e65f0d13ba65 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:59.477815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16a4b-d072-4a74-9e90-64275e7e0de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:59.478465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16a4b-d072-4a74-9e90-64275e7e0de5 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:59.478748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16a4b-d072-4a74-9e90-64275e7e0de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:59.479056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16a4b-d072-4a74-9e90-64275e7e0de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:59.487842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf16a4b-d072-4a74-9e90-64275e7e0de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:59.489319 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf16a4b-d072-4a74-9e90-64275e7e0de5 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:59.499802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1033/2044] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:46:59 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:46:59.499961 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1012/2045] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:46:59.502205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898b7e-2cce-4c97-89a8-4ca549060921 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:59.503933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a8898b7e-2cce-4c97-89a8-4ca549060921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:59.517724 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898b7e-2cce-4c97-89a8-4ca549060921 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:59.523470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6723e9-bf13-4b4a-9bb6-33e1faeb0926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:59.524756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6723e9-bf13-4b4a-9bb6-33e1faeb0926 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:59.525107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6723e9-bf13-4b4a-9bb6-33e1faeb0926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:59.525670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6723e9-bf13-4b4a-9bb6-33e1faeb0926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:59.526673 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6723e9-bf13-4b4a-9bb6-33e1faeb0926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:59.530338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6723e9-bf13-4b4a-9bb6-33e1faeb0926 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:59.539389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1034/2046] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:46:59.544719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16a4b-d072-4a74-9e90-64275e7e0de5 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:59.555425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16a4b-d072-4a74-9e90-64275e7e0de5 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:59.563087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a46e5-3f00-451b-9b02-8f9922ac44bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:59.564328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a46e5-3f00-451b-9b02-8f9922ac44bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:59.564654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a46e5-3f00-451b-9b02-8f9922ac44bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:59.565006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a46e5-3f00-451b-9b02-8f9922ac44bf admin admin] PATH_INFO: `/v3/projects/e55aee8259e84349858d338bc7de510f/users/695220246e814906a11e09a46d68778c/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:59.584549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a46e5-3f00-451b-9b02-8f9922ac44bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55aee8259e84349858d338bc7de510f, user_id=695220246e814906a11e09a46d68778c, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:59.587237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a46e5-3f00-451b-9b02-8f9922ac44bf admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:59.600861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:59.706193 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:59.712999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1013/2047] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:59 2022] PUT /identity/v3/projects/e55aee8259e84349858d338bc7de510f/users/695220246e814906a11e09a46d68778c/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:59.716774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6723e9-bf13-4b4a-9bb6-33e1faeb0926 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:59.727391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6723e9-bf13-4b4a-9bb6-33e1faeb0926 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:59.797240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebc9b6-4ae2-47fd-8e64-e17fd292c04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:59.797898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebc9b6-4ae2-47fd-8e64-e17fd292c04a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:59.798180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebc9b6-4ae2-47fd-8e64-e17fd292c04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:59.798454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebc9b6-4ae2-47fd-8e64-e17fd292c04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:59.799230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebc9b6-4ae2-47fd-8e64-e17fd292c04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:59.800850 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebc9b6-4ae2-47fd-8e64-e17fd292c04a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:59.811615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1035/2048] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:46:59.815965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a46e5-3f00-451b-9b02-8f9922ac44bf admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:59.829150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a46e5-3f00-451b-9b02-8f9922ac44bf admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:46:59.833918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5d9e3-120d-4967-841e-29912e6a2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:46:59.834804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5d9e3-120d-4967-841e-29912e6a2715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:59.835087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5d9e3-120d-4967-841e-29912e6a2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:59.835363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5d9e3-120d-4967-841e-29912e6a2715 admin admin] PATH_INFO: `/v3/projects/e55aee8259e84349858d338bc7de510f/users/695220246e814906a11e09a46d68778c/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:59.837384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5d9e3-120d-4967-841e-29912e6a2715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55aee8259e84349858d338bc7de510f, user_id=695220246e814906a11e09a46d68778c, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:46:59.840134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5d9e3-120d-4967-841e-29912e6a2715 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:46:59.850741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1014/2049] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:46:59 2022] PUT /identity/v3/projects/e55aee8259e84349858d338bc7de510f/users/695220246e814906a11e09a46d68778c/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:46:59.861692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68d6a-67a0-4cc9-8aa7-f645843a07cd None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:46:59.861993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68d6a-67a0-4cc9-8aa7-f645843a07cd None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:46:59.862284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68d6a-67a0-4cc9-8aa7-f645843a07cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:46:59.890428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c7d68d6a-67a0-4cc9-8aa7-f645843a07cd None None] MFA Rules not processed for user `695220246e814906a11e09a46d68778c`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:46:59.894795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c7d68d6a-67a0-4cc9-8aa7-f645843a07cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:59.966196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1036/2050] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:46:59.977882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5d9e3-120d-4967-841e-29912e6a2715 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:59.980242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-04d5d9e3-120d-4967-841e-29912e6a2715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:46:59.990073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68d6a-67a0-4cc9-8aa7-f645843a07cd None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:46:59.992685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c7d68d6a-67a0-4cc9-8aa7-f645843a07cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:00.046873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5d9e3-120d-4967-841e-29912e6a2715 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:00.050736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411c50-1def-4473-ab2f-ce36867e210f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:00.051488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411c50-1def-4473-ab2f-ce36867e210f service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:00.052635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411c50-1def-4473-ab2f-ce36867e210f service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:00.053085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411c50-1def-4473-ab2f-ce36867e210f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:00.063707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68d6a-67a0-4cc9-8aa7-f645843a07cd None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:00.066048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7411c50-1def-4473-ab2f-ce36867e210f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:00.067516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7411c50-1def-4473-ab2f-ce36867e210f service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:00.073532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:00.073532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:00.073532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:00.073532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] PATH_INFO: `/v3/projects/66a512893ae243c7b7e4573b02134dcf` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:00.073885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a512893ae243c7b7e4573b02134dcf)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:00.077564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:00.078925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1015/2051] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:46:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:47:00.206337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a512893ae243c7b7e4573b02134dcf', 'request_id': 'req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.209048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a512893ae243c7b7e4573b02134dcf', 'request_id': 'req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.269617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a512893ae243c7b7e4573b02134dcf', 'request_id': 'req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.282092 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] The token cache is being invalidate because project 66a512893ae243c7b7e4573b02134dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:00.282380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.283029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.284628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1037/2052] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:46:59 2022] DELETE /identity/v3/projects/66a512893ae243c7b7e4573b02134dcf => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:00.288540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411c50-1def-4473-ab2f-ce36867e210f service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:00.299461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411c50-1def-4473-ab2f-ce36867e210f service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:00.361225 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:00.362105 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:00.362388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:00.362666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] PATH_INFO: `/v3/users/0d679c6064304000bc78e343afe22959` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:00.363939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d679c6064304000bc78e343afe22959)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:00.365992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:00.624137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:00.637325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d679c6064304000bc78e343afe22959'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.637979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d679c6064304000bc78e343afe22959'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.644738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d679c6064304000bc78e343afe22959'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.656374 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d679c6064304000bc78e343afe22959'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.732616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d679c6064304000bc78e343afe22959'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:00.739265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1016/2053] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:00 2022] DELETE /identity/v3/users/0d679c6064304000bc78e343afe22959 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:01.065816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:01.067370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:01.086694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5dda8-c8e0-43c6-906e-f2ff62710eb5 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:01.149194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:01.150000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:01.150288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:01.150566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] PATH_INFO: `/v3/users/ed08cb45810b45c89cca28773acaad0b` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:01.153068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed08cb45810b45c89cca28773acaad0b)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:01.155228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:01.237264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:01.239669 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:01.254256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cf62d-83f8-4420-808c-c2544398f664 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:01.273271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:01.274152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:01.274437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:01.274715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] PATH_INFO: `/v3/projects/411496452b514b418b75b6f845f8f859` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:01.276600 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] RBAC: Authorizing `identity:delete_project(project_id=411496452b514b418b75b6f845f8f859)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:01.278583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:01.345010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:01.358003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed08cb45810b45c89cca28773acaad0b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.404811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411496452b514b418b75b6f845f8f859', 'request_id': 'req-a9e995f6-428f-4a0e-8265-f0a7e057672b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.452120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed08cb45810b45c89cca28773acaad0b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.452768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed08cb45810b45c89cca28773acaad0b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.453628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed08cb45810b45c89cca28773acaad0b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.461275 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed08cb45810b45c89cca28773acaad0b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.478914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1038/2054] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:01 2022] DELETE /identity/v3/users/ed08cb45810b45c89cca28773acaad0b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:01.479964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:01.481377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:01.497812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411496452b514b418b75b6f845f8f859', 'request_id': 'req-a9e995f6-428f-4a0e-8265-f0a7e057672b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.504691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411496452b514b418b75b6f845f8f859', 'request_id': 'req-a9e995f6-428f-4a0e-8265-f0a7e057672b'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.516485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] The token cache is being invalidate because project 411496452b514b418b75b6f845f8f859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:01.516869 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.517491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e995f6-428f-4a0e-8265-f0a7e057672b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.519073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1017/2055] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:01 2022] DELETE /identity/v3/projects/411496452b514b418b75b6f845f8f859 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:47:01.520454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae6a6c-c21f-4443-9fdf-558688f5a9d6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:01.520723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae6a6c-c21f-4443-9fdf-558688f5a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:01.520997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae6a6c-c21f-4443-9fdf-558688f5a9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:01.538896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-29ae6a6c-c21f-4443-9fdf-558688f5a9d6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:01.540097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-29ae6a6c-c21f-4443-9fdf-558688f5a9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:01.549617 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1018/2056] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:01.550442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae6a6c-c21f-4443-9fdf-558688f5a9d6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:01.551035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6defbd-539a-4fec-ae86-382abee1da45 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:01.551751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-29ae6a6c-c21f-4443-9fdf-558688f5a9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:01.557075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:01.558525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:01.558912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:01.559265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] PATH_INFO: `/v3/users/2676f3735cbc4a15aceabde48b02c39b` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:01.560522 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2676f3735cbc4a15aceabde48b02c39b)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:01.562522 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:01.565438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae6a6c-c21f-4443-9fdf-558688f5a9d6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:01.572158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:01.578841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:01.578841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:01.578841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] PATH_INFO: `/v3/users/91f1e5364ee14f28b7a5e7a3f476fbb9` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:01.578841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f1e5364ee14f28b7a5e7a3f476fbb9)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:01.578841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:01.595640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:01.722650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2676f3735cbc4a15aceabde48b02c39b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.789705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2676f3735cbc4a15aceabde48b02c39b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.790493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2676f3735cbc4a15aceabde48b02c39b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.791201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2676f3735cbc4a15aceabde48b02c39b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.798530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f1e5364ee14f28b7a5e7a3f476fbb9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.799359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f1e5364ee14f28b7a5e7a3f476fbb9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.799574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2676f3735cbc4a15aceabde48b02c39b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.806620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f1e5364ee14f28b7a5e7a3f476fbb9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.818171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1039/2057] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:01 2022] DELETE /identity/v3/users/2676f3735cbc4a15aceabde48b02c39b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:01.818985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:01.821418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f1e5364ee14f28b7a5e7a3f476fbb9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.822008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:01.877160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183d48-825f-48f6-88e7-f7936995bb63 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:01.880845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:01.881488 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:01.881767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:01.882039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:01.883848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:01.908765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9b205632-52d8-4e17-ba5c-a889a8a16b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f1e5364ee14f28b7a5e7a3f476fbb9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:01.918743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1019/2058] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:01 2022] DELETE /identity/v3/users/91f1e5364ee14f28b7a5e7a3f476fbb9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:01.920442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba9202-7e3a-49d0-bbf5-e08cc730886a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:01.920920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba9202-7e3a-49d0-bbf5-e08cc730886a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:01.921329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba9202-7e3a-49d0-bbf5-e08cc730886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:01.940940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0dba9202-7e3a-49d0-bbf5-e08cc730886a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:01.942303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0dba9202-7e3a-49d0-bbf5-e08cc730886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:01.958741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:01.960517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:01.973003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1040/2059] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:47:02.003724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1020/2060] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:02.014461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:02.015908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:02.027840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91643aa2-9ddd-45cc-852e-4d3f807b9a1e service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:02.080077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728f439-0112-4625-be71-1d0bd0011f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:02.080801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728f439-0112-4625-be71-1d0bd0011f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:02.081079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728f439-0112-4625-be71-1d0bd0011f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:02.081354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728f439-0112-4625-be71-1d0bd0011f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:02.098859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728f439-0112-4625-be71-1d0bd0011f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:02.100682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728f439-0112-4625-be71-1d0bd0011f5f service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:02.111546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1041/2061] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:47:02.252926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:02.287722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:02.464434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba9202-7e3a-49d0-bbf5-e08cc730886a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:02.477771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0dba9202-7e3a-49d0-bbf5-e08cc730886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:02.498912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba9202-7e3a-49d0-bbf5-e08cc730886a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:02.511237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:02.511237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:02.511237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:02.511237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] PATH_INFO: `/v3/projects/ad2164c8591143ecbf39a2b9f18f2b00` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:02.511621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2164c8591143ecbf39a2b9f18f2b00)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:02.511621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:02.532037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728f439-0112-4625-be71-1d0bd0011f5f service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:02.533839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8728f439-0112-4625-be71-1d0bd0011f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:02.550186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728f439-0112-4625-be71-1d0bd0011f5f service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:02.555307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:02.559477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:02.559477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:02.559477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] PATH_INFO: `/v3/projects/d727216050fa49bd87827ee7f5bb33de` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:02.559477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d727216050fa49bd87827ee7f5bb33de)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:02.562072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:02.639131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2164c8591143ecbf39a2b9f18f2b00', 'request_id': 'req-dd27111d-110a-474d-b26a-d01f433e1fb2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:02.687545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd727216050fa49bd87827ee7f5bb33de', 'request_id': 'req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:02.693514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd727216050fa49bd87827ee7f5bb33de', 'request_id': 'req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:02.909815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2164c8591143ecbf39a2b9f18f2b00', 'request_id': 'req-dd27111d-110a-474d-b26a-d01f433e1fb2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:02.917102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2164c8591143ecbf39a2b9f18f2b00', 'request_id': 'req-dd27111d-110a-474d-b26a-d01f433e1fb2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:02.927069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] The token cache is being invalidate because project ad2164c8591143ecbf39a2b9f18f2b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:03.038459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.038459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.038459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1021/2062] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:02 2022] DELETE /identity/v3/projects/ad2164c8591143ecbf39a2b9f18f2b00 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:03.038459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:03.038459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:03.039444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27111d-110a-474d-b26a-d01f433e1fb2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:03.058601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:03.059585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:03.059873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:03.060152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] PATH_INFO: `/v3/projects/a9f2e1cd737a4910b2701bfee4b2f720` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:03.061403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f2e1cd737a4910b2701bfee4b2f720)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:03.063338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:03.264213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd727216050fa49bd87827ee7f5bb33de', 'request_id': 'req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.276397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] The token cache is being invalidate because project d727216050fa49bd87827ee7f5bb33de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:03.278595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.278595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d76ccb6-66fd-456c-b1ad-93d13ac5b1fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.279066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1042/2063] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:02 2022] DELETE /identity/v3/projects/d727216050fa49bd87827ee7f5bb33de => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:03.281030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342519e-c9a7-4174-b5be-02d2affcec0d None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:03.281323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342519e-c9a7-4174-b5be-02d2affcec0d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:03.281601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342519e-c9a7-4174-b5be-02d2affcec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:03.299573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6342519e-c9a7-4174-b5be-02d2affcec0d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:03.300808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6342519e-c9a7-4174-b5be-02d2affcec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:03.308650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1043/2064] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:03.309419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342519e-c9a7-4174-b5be-02d2affcec0d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:03.310585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6342519e-c9a7-4174-b5be-02d2affcec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:03.321791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342519e-c9a7-4174-b5be-02d2affcec0d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:03.326769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:03.327638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:03.328175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:03.328493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] PATH_INFO: `/v3/users/695220246e814906a11e09a46d68778c` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:03.329717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=695220246e814906a11e09a46d68778c)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:03.331772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:03.402652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f2e1cd737a4910b2701bfee4b2f720', 'request_id': 'req-94861e7c-51df-49f0-8e81-1155694bbedc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.481193 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f2e1cd737a4910b2701bfee4b2f720', 'request_id': 'req-94861e7c-51df-49f0-8e81-1155694bbedc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.488536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f2e1cd737a4910b2701bfee4b2f720', 'request_id': 'req-94861e7c-51df-49f0-8e81-1155694bbedc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.500171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] The token cache is being invalidate because project a9f2e1cd737a4910b2701bfee4b2f720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:03.500488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.501133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-94861e7c-51df-49f0-8e81-1155694bbedc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.502711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1022/2065] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:02 2022] DELETE /identity/v3/projects/a9f2e1cd737a4910b2701bfee4b2f720 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:03.504101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09530-ee35-459c-9283-b42e63fd4e66 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:03.504419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09530-ee35-459c-9283-b42e63fd4e66 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:03.504697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09530-ee35-459c-9283-b42e63fd4e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:03.526791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-04a09530-ee35-459c-9283-b42e63fd4e66 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:03.528048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-04a09530-ee35-459c-9283-b42e63fd4e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:03.545899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695220246e814906a11e09a46d68778c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.592214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1023/2066] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:03.593131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a09530-ee35-459c-9283-b42e63fd4e66 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:03.594438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-04a09530-ee35-459c-9283-b42e63fd4e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:03.605880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a09530-ee35-459c-9283-b42e63fd4e66 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:03.610500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:03.611415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:03.611700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:03.611975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] PATH_INFO: `/v3/users/6d92425d8b3145efa656bc228f6a81a6` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:03.613220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d92425d8b3145efa656bc228f6a81a6)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:03.615132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:03.623031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695220246e814906a11e09a46d68778c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.623676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695220246e814906a11e09a46d68778c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.624422 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695220246e814906a11e09a46d68778c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.630973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:03.641921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695220246e814906a11e09a46d68778c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.652976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1044/2067] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:03 2022] DELETE /identity/v3/users/695220246e814906a11e09a46d68778c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:03.655901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:03.655901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:03.693308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:03.735583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab35389-a7bd-4efd-bcaa-c3eae479c2dc admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:03.740823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0d83a-b197-417b-9bd0-a98db9ab9478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:03.741570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d83a-b197-417b-9bd0-a98db9ab9478 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:03.741857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d83a-b197-417b-9bd0-a98db9ab9478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:03.742185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d83a-b197-417b-9bd0-a98db9ab9478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:03.743177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0d83a-b197-417b-9bd0-a98db9ab9478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:47:03.743177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0d83a-b197-417b-9bd0-a98db9ab9478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:03.745007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0d83a-b197-417b-9bd0-a98db9ab9478 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:03.760037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1045/2068] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:47:03.764921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0d83a-b197-417b-9bd0-a98db9ab9478 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:03.775107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0d83a-b197-417b-9bd0-a98db9ab9478 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:03.780797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70f52-9f9b-4665-abe9-5dc0bd985e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:03.781467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70f52-9f9b-4665-abe9-5dc0bd985e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:03.781759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70f52-9f9b-4665-abe9-5dc0bd985e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:03.782042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70f52-9f9b-4665-abe9-5dc0bd985e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:03.782799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b70f52-9f9b-4665-abe9-5dc0bd985e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:03.784902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b70f52-9f9b-4665-abe9-5dc0bd985e8c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:03.821312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d92425d8b3145efa656bc228f6a81a6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.830160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d92425d8b3145efa656bc228f6a81a6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.830447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d92425d8b3145efa656bc228f6a81a6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.842674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d92425d8b3145efa656bc228f6a81a6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.904596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1046/2069] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:47:03 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:47:03.908927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70f52-9f9b-4665-abe9-5dc0bd985e8c admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:03.910081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d92425d8b3145efa656bc228f6a81a6'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:03.918910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1024/2070] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:03 2022] DELETE /identity/v3/users/6d92425d8b3145efa656bc228f6a81a6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:03.945659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:03.994651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70f52-9f9b-4665-abe9-5dc0bd985e8c admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.055022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba78505-8fea-44b6-a1cf-c595d4a541da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.055723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba78505-8fea-44b6-a1cf-c595d4a541da admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.056008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba78505-8fea-44b6-a1cf-c595d4a541da admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.056287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba78505-8fea-44b6-a1cf-c595d4a541da admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.057010 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba78505-8fea-44b6-a1cf-c595d4a541da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.059551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba78505-8fea-44b6-a1cf-c595d4a541da admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.111994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.114060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:04.127882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a77c5-bda2-4266-a3fa-cb0d3a38e4b2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.133793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.134707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.135001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.135397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] PATH_INFO: `/v3/projects/e55aee8259e84349858d338bc7de510f` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.137230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e55aee8259e84349858d338bc7de510f)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.139331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.170016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1047/2071] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:47:03 2022] POST /identity/v3/users => generated 284 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:47:04.174175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba78505-8fea-44b6-a1cf-c595d4a541da admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.176143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bba78505-8fea-44b6-a1cf-c595d4a541da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:04.189326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba78505-8fea-44b6-a1cf-c595d4a541da admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.194306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9893fd-f455-4993-a128-98005efb7bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.195015 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9893fd-f455-4993-a128-98005efb7bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.195269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9893fd-f455-4993-a128-98005efb7bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.195620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9893fd-f455-4993-a128-98005efb7bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.196345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9893fd-f455-4993-a128-98005efb7bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.197972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9893fd-f455-4993-a128-98005efb7bfc admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.208733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1048/2072] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:47:04.213201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9893fd-f455-4993-a128-98005efb7bfc admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.224888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9893fd-f455-4993-a128-98005efb7bfc admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.230227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78965dc5-3e09-4b1f-a8cf-bf586022caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.230890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965dc5-3e09-4b1f-a8cf-bf586022caac admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.231177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965dc5-3e09-4b1f-a8cf-bf586022caac admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.231459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965dc5-3e09-4b1f-a8cf-bf586022caac admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.232183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78965dc5-3e09-4b1f-a8cf-bf586022caac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.233835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78965dc5-3e09-4b1f-a8cf-bf586022caac admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.247044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1049/2073] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:47:04.251586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78965dc5-3e09-4b1f-a8cf-bf586022caac admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.261925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78965dc5-3e09-4b1f-a8cf-bf586022caac admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.263701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e55aee8259e84349858d338bc7de510f', 'request_id': 'req-85ce59c7-6990-4eac-946a-e6afe908be30'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.310235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:04.323077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aefaf9-339f-407e-993c-bdc03724cf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.323972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aefaf9-339f-407e-993c-bdc03724cf10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.324261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aefaf9-339f-407e-993c-bdc03724cf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.324575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aefaf9-339f-407e-993c-bdc03724cf10 admin admin] PATH_INFO: `/v3/projects/fe3c92bea76045d29a2884ee473c42cc/users/9c50f83286304d438f0a578fa2964708/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.332355 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e55aee8259e84349858d338bc7de510f', 'request_id': 'req-85ce59c7-6990-4eac-946a-e6afe908be30'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.339975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aefaf9-339f-407e-993c-bdc03724cf10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3c92bea76045d29a2884ee473c42cc, user_id=9c50f83286304d438f0a578fa2964708, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.340646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e55aee8259e84349858d338bc7de510f', 'request_id': 'req-85ce59c7-6990-4eac-946a-e6afe908be30'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.342747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aefaf9-339f-407e-993c-bdc03724cf10 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.361085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] The token cache is being invalidate because project e55aee8259e84349858d338bc7de510f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:04.361464 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.362180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.364446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1025/2074] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:04 2022] DELETE /identity/v3/projects/e55aee8259e84349858d338bc7de510f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:47:04.365588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.367038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:04.381988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce59c7-6990-4eac-946a-e6afe908be30 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.386938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.387881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.388167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.388482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] PATH_INFO: `/v3/projects/fe4b53826905466da2d3eb3e056e9227` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.389705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4b53826905466da2d3eb3e056e9227)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.391636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.426613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1050/2075] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:47:04 2022] PUT /identity/v3/projects/fe3c92bea76045d29a2884ee473c42cc/users/9c50f83286304d438f0a578fa2964708/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:47:04.436196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14423b-dbbd-4487-8443-42f50b577555 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.436196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14423b-dbbd-4487-8443-42f50b577555 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.436196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14423b-dbbd-4487-8443-42f50b577555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.452809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2a14423b-dbbd-4487-8443-42f50b577555 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:04.452809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2a14423b-dbbd-4487-8443-42f50b577555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:04.522934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4b53826905466da2d3eb3e056e9227', 'request_id': 'req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.526085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1051/2076] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:04.529747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a273e4b-1acc-4caa-bf1d-a58f6af64a3b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.530047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a273e4b-1acc-4caa-bf1d-a58f6af64a3b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.530331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a273e4b-1acc-4caa-bf1d-a58f6af64a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.558400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-0a273e4b-1acc-4caa-bf1d-a58f6af64a3b None None] MFA Rules not processed for user `9c50f83286304d438f0a578fa2964708`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:04.559686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0a273e4b-1acc-4caa-bf1d-a58f6af64a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:04.573452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:04.595228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4b53826905466da2d3eb3e056e9227', 'request_id': 'req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.602718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4b53826905466da2d3eb3e056e9227', 'request_id': 'req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.616539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] The token cache is being invalidate because project fe4b53826905466da2d3eb3e056e9227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:04.617764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.618471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a7ee3c63-35f4-468a-a43a-33ac3637d5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:04.620666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1026/2077] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:04 2022] DELETE /identity/v3/projects/fe4b53826905466da2d3eb3e056e9227 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:04.621933 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542addb-bd7e-4a3b-b7d2-f3ed386f5a15 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.623016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542addb-bd7e-4a3b-b7d2-f3ed386f5a15 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.623495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542addb-bd7e-4a3b-b7d2-f3ed386f5a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.642097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1052/2078] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:04.643463 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74cc9-23c3-4f6b-b001-15edf48dd450 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.643759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74cc9-23c3-4f6b-b001-15edf48dd450 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.644042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74cc9-23c3-4f6b-b001-15edf48dd450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.644246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-5542addb-bd7e-4a3b-b7d2-f3ed386f5a15 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:04.645629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5542addb-bd7e-4a3b-b7d2-f3ed386f5a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:04.664568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-efc74cc9-23c3-4f6b-b001-15edf48dd450 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:04.666019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-efc74cc9-23c3-4f6b-b001-15edf48dd450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:04.708140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1027/2079] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:04.709020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542addb-bd7e-4a3b-b7d2-f3ed386f5a15 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.710279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5542addb-bd7e-4a3b-b7d2-f3ed386f5a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:04.728983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1053/2080] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:04.733215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74cc9-23c3-4f6b-b001-15edf48dd450 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.742670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74cc9-23c3-4f6b-b001-15edf48dd450 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.755460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac885c5-68c2-4a54-9dac-372d79062b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.755460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac885c5-68c2-4a54-9dac-372d79062b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.755460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac885c5-68c2-4a54-9dac-372d79062b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.755460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac885c5-68c2-4a54-9dac-372d79062b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.755893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac885c5-68c2-4a54-9dac-372d79062b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:47:04.755893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac885c5-68c2-4a54-9dac-372d79062b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.755893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac885c5-68c2-4a54-9dac-372d79062b89 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.763426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1054/2081] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:47:04.765633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02390dc1-546b-479e-ad16-86d91828fb3d None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.765929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02390dc1-546b-479e-ad16-86d91828fb3d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.766221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02390dc1-546b-479e-ad16-86d91828fb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.769688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542addb-bd7e-4a3b-b7d2-f3ed386f5a15 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.773451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3625e77-4b39-439b-90a6-a243191bbb5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9533e8371e64161a4c54eeab867a17e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.774144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3625e77-4b39-439b-90a6-a243191bbb5a service glance] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.774427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3625e77-4b39-439b-90a6-a243191bbb5a service glance] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.774701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3625e77-4b39-439b-90a6-a243191bbb5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.784078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3625e77-4b39-439b-90a6-a243191bbb5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.785580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3625e77-4b39-439b-90a6-a243191bbb5a service glance] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.785810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-02390dc1-546b-479e-ad16-86d91828fb3d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:04.787020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-02390dc1-546b-479e-ad16-86d91828fb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:04.794971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1028/2082] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:47:04.795742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3625e77-4b39-439b-90a6-a243191bbb5a service glance] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.796902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:04.802053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1055/2083] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:04.803485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02390dc1-546b-479e-ad16-86d91828fb3d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.806301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3625e77-4b39-439b-90a6-a243191bbb5a service glance] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.813326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02390dc1-546b-479e-ad16-86d91828fb3d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.819250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:04.821631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df013def-6f11-4649-8829-8b7465a2e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.822341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df013def-6f11-4649-8829-8b7465a2e86c admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.822631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df013def-6f11-4649-8829-8b7465a2e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.823005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df013def-6f11-4649-8829-8b7465a2e86c admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.823822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bfba8-54e4-47ed-992a-eaedfdb70c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.824623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bfba8-54e4-47ed-992a-eaedfdb70c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.830583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bfba8-54e4-47ed-992a-eaedfdb70c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.830937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df013def-6f11-4649-8829-8b7465a2e86c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:47:04.830937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df013def-6f11-4649-8829-8b7465a2e86c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.830937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df013def-6f11-4649-8829-8b7465a2e86c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.831170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bfba8-54e4-47ed-992a-eaedfdb70c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.831170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bfba8-54e4-47ed-992a-eaedfdb70c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.831838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bfba8-54e4-47ed-992a-eaedfdb70c4a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.841801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1056/2084] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:47:04.846487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df013def-6f11-4649-8829-8b7465a2e86c admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.862847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df013def-6f11-4649-8829-8b7465a2e86c admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:04.864132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393b3b-4bd2-46ea-9730-d94f15f03a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:04.864829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393b3b-4bd2-46ea-9730-d94f15f03a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:04.865116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393b3b-4bd2-46ea-9730-d94f15f03a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:04.865516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393b3b-4bd2-46ea-9730-d94f15f03a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:04.866284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393b3b-4bd2-46ea-9730-d94f15f03a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:04.868343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393b3b-4bd2-46ea-9730-d94f15f03a35 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:04.924265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1029/2085] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:47:04 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:47:04.928041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bfba8-54e4-47ed-992a-eaedfdb70c4a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:04.994504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1057/2086] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:47:04 2022] POST /identity/v3/projects => generated 361 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:47:05.002660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393b3b-4bd2-46ea-9730-d94f15f03a35 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.020122 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bfba8-54e4-47ed-992a-eaedfdb70c4a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.089962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393b3b-4bd2-46ea-9730-d94f15f03a35 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.094754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde894-bdac-4fc7-b89f-63b53a489321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.095554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bbbf8-3d50-4232-911e-c80463281b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.100450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde894-bdac-4fc7-b89f-63b53a489321 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.100450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde894-bdac-4fc7-b89f-63b53a489321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.100641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bbbf8-3d50-4232-911e-c80463281b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.100732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde894-bdac-4fc7-b89f-63b53a489321 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.100843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bbbf8-3d50-4232-911e-c80463281b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.100843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bbbf8-3d50-4232-911e-c80463281b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.100843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bbbf8-3d50-4232-911e-c80463281b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.101164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde894-bdac-4fc7-b89f-63b53a489321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.101255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bbbf8-3d50-4232-911e-c80463281b20 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.101369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde894-bdac-4fc7-b89f-63b53a489321 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.196662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1058/2087] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:47:04 2022] POST /identity/v3/users => generated 281 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:47:05.199150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1030/2088] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:47:04 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:47:05.201760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bbbf8-3d50-4232-911e-c80463281b20 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.202253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:05.204939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde894-bdac-4fc7-b89f-63b53a489321 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.212207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bbbf8-3d50-4232-911e-c80463281b20 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.216616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde894-bdac-4fc7-b89f-63b53a489321 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.220879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ea31b-9d62-4cf3-8248-a2504d6220d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.220879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ea31b-9d62-4cf3-8248-a2504d6220d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.220879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ea31b-9d62-4cf3-8248-a2504d6220d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.220879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ea31b-9d62-4cf3-8248-a2504d6220d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.221814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ea31b-9d62-4cf3-8248-a2504d6220d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.221814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ea31b-9d62-4cf3-8248-a2504d6220d3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.221980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b9364-8001-4f9b-b31d-c1ea85c82e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.222554 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9364-8001-4f9b-b31d-c1ea85c82e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.222905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9364-8001-4f9b-b31d-c1ea85c82e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.223267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9364-8001-4f9b-b31d-c1ea85c82e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.224071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b9364-8001-4f9b-b31d-c1ea85c82e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.225775 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b9364-8001-4f9b-b31d-c1ea85c82e86 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.231704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1059/2089] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:47:05.235617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ea31b-9d62-4cf3-8248-a2504d6220d3 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.236700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1031/2090] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:47:05.240311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b9364-8001-4f9b-b31d-c1ea85c82e86 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.247802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ea31b-9d62-4cf3-8248-a2504d6220d3 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.250034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b9364-8001-4f9b-b31d-c1ea85c82e86 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.252446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5b11b-509e-4aa0-a3ef-cfbb7a451307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.253101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5b11b-509e-4aa0-a3ef-cfbb7a451307 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.253382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5b11b-509e-4aa0-a3ef-cfbb7a451307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.253650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5b11b-509e-4aa0-a3ef-cfbb7a451307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.254353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5b11b-509e-4aa0-a3ef-cfbb7a451307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.254669 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27520294-3300-484b-bab6-caf9cdae9169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.255325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520294-3300-484b-bab6-caf9cdae9169 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.255654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520294-3300-484b-bab6-caf9cdae9169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.255928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5b11b-509e-4aa0-a3ef-cfbb7a451307 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.256047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520294-3300-484b-bab6-caf9cdae9169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.256670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27520294-3300-484b-bab6-caf9cdae9169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.258260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27520294-3300-484b-bab6-caf9cdae9169 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.271355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1060/2091] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:47:05.271559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1032/2092] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:47:05.273225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5b11b-509e-4aa0-a3ef-cfbb7a451307 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.273451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27520294-3300-484b-bab6-caf9cdae9169 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.283783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5b11b-509e-4aa0-a3ef-cfbb7a451307 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.283944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27520294-3300-484b-bab6-caf9cdae9169 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.288733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f934d0-66c0-4e9d-8a74-2d9e4b201641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.289371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70232890-d1ed-4e01-805a-b5892a66ea36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.289607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f934d0-66c0-4e9d-8a74-2d9e4b201641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.289889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f934d0-66c0-4e9d-8a74-2d9e4b201641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.290164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f934d0-66c0-4e9d-8a74-2d9e4b201641 admin admin] PATH_INFO: `/v3/projects/d719495c4ff5447ea0f1c02a63c22ba3/users/5b4185a498544c0ab1962645aa350eda/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.290638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70232890-d1ed-4e01-805a-b5892a66ea36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.291012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70232890-d1ed-4e01-805a-b5892a66ea36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.291459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70232890-d1ed-4e01-805a-b5892a66ea36 admin admin] PATH_INFO: `/v3/projects/9c8dd37c92374f27aa007fad61ce9fba/users/a9dbd1e2d78747d6921257814f68a3e5/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.305480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f934d0-66c0-4e9d-8a74-2d9e4b201641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d719495c4ff5447ea0f1c02a63c22ba3, user_id=5b4185a498544c0ab1962645aa350eda, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.311903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f934d0-66c0-4e9d-8a74-2d9e4b201641 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.312065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70232890-d1ed-4e01-805a-b5892a66ea36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8dd37c92374f27aa007fad61ce9fba, user_id=a9dbd1e2d78747d6921257814f68a3e5, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.312065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70232890-d1ed-4e01-805a-b5892a66ea36 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.367418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1061/2094] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:47:05 2022] PUT /identity/v3/projects/9c8dd37c92374f27aa007fad61ce9fba/users/a9dbd1e2d78747d6921257814f68a3e5/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:05.369116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1033/2094] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:47:05 2022] PUT /identity/v3/projects/d719495c4ff5447ea0f1c02a63c22ba3/users/5b4185a498544c0ab1962645aa350eda/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:47:05.378802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2c7a-dab9-47d9-a016-bbfeacaf24ee None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.378992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843523f6-22d5-424d-b778-e1cbb5b447fc None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.379096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2c7a-dab9-47d9-a016-bbfeacaf24ee None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.379200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843523f6-22d5-424d-b778-e1cbb5b447fc None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.379347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2c7a-dab9-47d9-a016-bbfeacaf24ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.379470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843523f6-22d5-424d-b778-e1cbb5b447fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.407175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-97fc2c7a-dab9-47d9-a016-bbfeacaf24ee None None] MFA Rules not processed for user `5b4185a498544c0ab1962645aa350eda`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:05.407534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-843523f6-22d5-424d-b778-e1cbb5b447fc None None] MFA Rules not processed for user `a9dbd1e2d78747d6921257814f68a3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:05.408564 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-97fc2c7a-dab9-47d9-a016-bbfeacaf24ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:05.408764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-843523f6-22d5-424d-b778-e1cbb5b447fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:05.470133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:05.484659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1034/2096] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:05.484876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1062/2096] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:05.489929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843523f6-22d5-424d-b778-e1cbb5b447fc None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.554534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843523f6-22d5-424d-b778-e1cbb5b447fc None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.561612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2c7a-dab9-47d9-a016-bbfeacaf24ee None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.565899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-97fc2c7a-dab9-47d9-a016-bbfeacaf24ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:05.569110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ab55-539b-4d63-bd1f-ce1c89969299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.570338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ab55-539b-4d63-bd1f-ce1c89969299 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.570719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ab55-539b-4d63-bd1f-ce1c89969299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.571090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ab55-539b-4d63-bd1f-ce1c89969299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.574053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ab55-539b-4d63-bd1f-ce1c89969299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.575641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ab55-539b-4d63-bd1f-ce1c89969299 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.637517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2c7a-dab9-47d9-a016-bbfeacaf24ee None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.641370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a89f-3c3d-49df-a00f-3a9e8204b233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.642035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a89f-3c3d-49df-a00f-3a9e8204b233 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.642305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a89f-3c3d-49df-a00f-3a9e8204b233 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.642579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a89f-3c3d-49df-a00f-3a9e8204b233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.652677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1a89f-3c3d-49df-a00f-3a9e8204b233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.655037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1a89f-3c3d-49df-a00f-3a9e8204b233 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.659819 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1035/2097] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:47:05 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:47:05.665900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ab55-539b-4d63-bd1f-ce1c89969299 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.666307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1063/2098] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:47:05.684022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a89f-3c3d-49df-a00f-3a9e8204b233 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.697572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a89f-3c3d-49df-a00f-3a9e8204b233 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.737256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ab55-539b-4d63-bd1f-ce1c89969299 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.742534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c60a6-31ec-463a-bd1e-28dbd63b9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.742534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c60a6-31ec-463a-bd1e-28dbd63b9750 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.742821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c60a6-31ec-463a-bd1e-28dbd63b9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.743076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c60a6-31ec-463a-bd1e-28dbd63b9750 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.743758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c60a6-31ec-463a-bd1e-28dbd63b9750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.746388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c60a6-31ec-463a-bd1e-28dbd63b9750 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.762741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.765478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.765478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.765478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] PATH_INFO: `/v3/users/a9dbd1e2d78747d6921257814f68a3e5` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.765478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9dbd1e2d78747d6921257814f68a3e5)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.767415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.816047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1036/2099] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:47:05 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:47:05.817672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c60a6-31ec-463a-bd1e-28dbd63b9750 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.827592 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c60a6-31ec-463a-bd1e-28dbd63b9750 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.832813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841d4a4-5134-4704-81c8-e8ea10f12d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.834364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841d4a4-5134-4704-81c8-e8ea10f12d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.834364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841d4a4-5134-4704-81c8-e8ea10f12d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.834364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841d4a4-5134-4704-81c8-e8ea10f12d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.834783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841d4a4-5134-4704-81c8-e8ea10f12d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.836617 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841d4a4-5134-4704-81c8-e8ea10f12d4c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.848434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1037/2100] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:47:05.852921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841d4a4-5134-4704-81c8-e8ea10f12d4c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:05.863564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841d4a4-5134-4704-81c8-e8ea10f12d4c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:05.868256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7484ca3-a55b-4208-ab62-8df45b687f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:05.869160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7484ca3-a55b-4208-ab62-8df45b687f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:05.869437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7484ca3-a55b-4208-ab62-8df45b687f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:05.869742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7484ca3-a55b-4208-ab62-8df45b687f75 admin admin] PATH_INFO: `/v3/projects/80a117a2d82b4dd2997257aede1fca7f/users/d3475036f82243e689e3f06c6a0a8875/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:05.885189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7484ca3-a55b-4208-ab62-8df45b687f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a117a2d82b4dd2997257aede1fca7f, user_id=d3475036f82243e689e3f06c6a0a8875, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:05.888066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7484ca3-a55b-4208-ab62-8df45b687f75 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:05.942479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9dbd1e2d78747d6921257814f68a3e5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:06.029720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9dbd1e2d78747d6921257814f68a3e5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:06.030474 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9dbd1e2d78747d6921257814f68a3e5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:06.031516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9dbd1e2d78747d6921257814f68a3e5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:06.036026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:06.043647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-45b263e7-ddc6-43e6-a720-8378f41cfc6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9dbd1e2d78747d6921257814f68a3e5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:06.044777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1038/2101] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:47:05 2022] PUT /identity/v3/projects/80a117a2d82b4dd2997257aede1fca7f/users/d3475036f82243e689e3f06c6a0a8875/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:06.049217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7484ca3-a55b-4208-ab62-8df45b687f75 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:06.051146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f7484ca3-a55b-4208-ab62-8df45b687f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:06.070548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1064/2102] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:05 2022] DELETE /identity/v3/users/a9dbd1e2d78747d6921257814f68a3e5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:47:06.074848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71a3f2-c855-4209-b8b8-fffa9e22451a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:06.075106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71a3f2-c855-4209-b8b8-fffa9e22451a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:06.075390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71a3f2-c855-4209-b8b8-fffa9e22451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:06.103521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8d71a3f2-c855-4209-b8b8-fffa9e22451a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:06.105686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8d71a3f2-c855-4209-b8b8-fffa9e22451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:06.111627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:06.157052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7484ca3-a55b-4208-ab62-8df45b687f75 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:06.232200 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1065/2103] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:06.245981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71a3f2-c855-4209-b8b8-fffa9e22451a None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:06.245981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8d71a3f2-c855-4209-b8b8-fffa9e22451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:06.262076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b581e0f-6cd5-4f84-b30b-97e2ea405bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:06.269866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b581e0f-6cd5-4f84-b30b-97e2ea405bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:06.269866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b581e0f-6cd5-4f84-b30b-97e2ea405bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:06.269866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b581e0f-6cd5-4f84-b30b-97e2ea405bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:06.269866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b581e0f-6cd5-4f84-b30b-97e2ea405bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:06.269866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b581e0f-6cd5-4f84-b30b-97e2ea405bf5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:06.277668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1039/2104] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:47:06.281590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b581e0f-6cd5-4f84-b30b-97e2ea405bf5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:06.292264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b581e0f-6cd5-4f84-b30b-97e2ea405bf5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:06.297018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fe2be-1640-4313-b974-f5bf73183e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:06.298471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fe2be-1640-4313-b974-f5bf73183e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:06.298471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fe2be-1640-4313-b974-f5bf73183e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:06.298660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fe2be-1640-4313-b974-f5bf73183e60 admin admin] PATH_INFO: `/v3/projects/80a117a2d82b4dd2997257aede1fca7f/users/d3475036f82243e689e3f06c6a0a8875/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:06.300656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fe2be-1640-4313-b974-f5bf73183e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a117a2d82b4dd2997257aede1fca7f, user_id=d3475036f82243e689e3f06c6a0a8875, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:06.303386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fe2be-1640-4313-b974-f5bf73183e60 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:06.317804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:06.328398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1040/2105] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:47:06 2022] PUT /identity/v3/projects/80a117a2d82b4dd2997257aede1fca7f/users/d3475036f82243e689e3f06c6a0a8875/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:47:06.339552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb081cc-73a3-4bdd-a7f8-d509763a9a90 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:06.340320 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb081cc-73a3-4bdd-a7f8-d509763a9a90 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:06.349329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb081cc-73a3-4bdd-a7f8-d509763a9a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:06.349450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71a3f2-c855-4209-b8b8-fffa9e22451a None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:06.370907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2bb081cc-73a3-4bdd-a7f8-d509763a9a90 None None] MFA Rules not processed for user `d3475036f82243e689e3f06c6a0a8875`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:06.372155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2bb081cc-73a3-4bdd-a7f8-d509763a9a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:06.402259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2816c-9dab-4d8c-9a13-67f0f12269c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:06.402918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2816c-9dab-4d8c-9a13-67f0f12269c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:06.403205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2816c-9dab-4d8c-9a13-67f0f12269c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:06.403496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2816c-9dab-4d8c-9a13-67f0f12269c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:06.420242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:06.450879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1041/2106] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:06.462229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb081cc-73a3-4bdd-a7f8-d509763a9a90 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:06.464707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2bb081cc-73a3-4bdd-a7f8-d509763a9a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:06.476902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2816c-9dab-4d8c-9a13-67f0f12269c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:06.478419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2816c-9dab-4d8c-9a13-67f0f12269c9 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:06.498323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:06.504667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1066/2107] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:47:06.553243 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb081cc-73a3-4bdd-a7f8-d509763a9a90 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:06.559805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844847c-22f0-47d9-a2b6-16706a965497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:06.560606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844847c-22f0-47d9-a2b6-16706a965497 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:06.560949 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844847c-22f0-47d9-a2b6-16706a965497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:06.561283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844847c-22f0-47d9-a2b6-16706a965497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:06.564511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3844847c-22f0-47d9-a2b6-16706a965497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:06.630127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844847c-22f0-47d9-a2b6-16706a965497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:06.631581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844847c-22f0-47d9-a2b6-16706a965497 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:06.640579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1042/2108] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:47:06.671046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:06.847471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:06.946270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2816c-9dab-4d8c-9a13-67f0f12269c9 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:06.947745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0cd2816c-9dab-4d8c-9a13-67f0f12269c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:06.965162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2816c-9dab-4d8c-9a13-67f0f12269c9 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:06.970287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:06.971163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:06.971451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:06.971728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] PATH_INFO: `/v3/projects/9c8dd37c92374f27aa007fad61ce9fba` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:06.972959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8dd37c92374f27aa007fad61ce9fba)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:06.975236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:06.979263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:07.129134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8dd37c92374f27aa007fad61ce9fba', 'request_id': 'req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:07.135607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8dd37c92374f27aa007fad61ce9fba', 'request_id': 'req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:07.206902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8dd37c92374f27aa007fad61ce9fba', 'request_id': 'req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:07.222595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] The token cache is being invalidate because project 9c8dd37c92374f27aa007fad61ce9fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:07.222595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:07.222814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-c6cf55b1-3139-4ae2-8f85-59a1ebce33d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:07.224404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1067/2109] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:06 2022] DELETE /identity/v3/projects/9c8dd37c92374f27aa007fad61ce9fba => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:07.230311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bdee8-94b6-4ff7-82e1-19080ea6a0c7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:07.230611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bdee8-94b6-4ff7-82e1-19080ea6a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:07.230898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bdee8-94b6-4ff7-82e1-19080ea6a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:07.249666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d66bdee8-94b6-4ff7-82e1-19080ea6a0c7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:07.250873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d66bdee8-94b6-4ff7-82e1-19080ea6a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:07.264199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:07.325511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1043/2110] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:07.327385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251984-bc3d-446e-95b3-b71be23a3acf None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:07.327934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251984-bc3d-446e-95b3-b71be23a3acf None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:07.328602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251984-bc3d-446e-95b3-b71be23a3acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:07.357114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-e9251984-bc3d-446e-95b3-b71be23a3acf None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:07.358532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e9251984-bc3d-446e-95b3-b71be23a3acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:07.361311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:07.367308 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1068/2111] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:47:07.372113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bdee8-94b6-4ff7-82e1-19080ea6a0c7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:07.382568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bdee8-94b6-4ff7-82e1-19080ea6a0c7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:07.390178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385a774-8fb3-4e28-bf20-aca3e3353f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:07.391082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385a774-8fb3-4e28-bf20-aca3e3353f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:07.391546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385a774-8fb3-4e28-bf20-aca3e3353f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:07.391975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385a774-8fb3-4e28-bf20-aca3e3353f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:07.392990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385a774-8fb3-4e28-bf20-aca3e3353f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:47:07.398297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385a774-8fb3-4e28-bf20-aca3e3353f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:07.398297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385a774-8fb3-4e28-bf20-aca3e3353f00 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:07.416569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1044/2112] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:47:07.419334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9251984-bc3d-446e-95b3-b71be23a3acf None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:07.430444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9251984-bc3d-446e-95b3-b71be23a3acf None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:07.436700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f339d0-eb7a-4dec-940a-9db2f5760d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:07.437526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f339d0-eb7a-4dec-940a-9db2f5760d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:07.437737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f339d0-eb7a-4dec-940a-9db2f5760d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:07.438051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f339d0-eb7a-4dec-940a-9db2f5760d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:07.438758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f339d0-eb7a-4dec-940a-9db2f5760d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:07.440841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f339d0-eb7a-4dec-940a-9db2f5760d70 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:07.536183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1069/2113] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:47:07 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:47:07.540034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385a774-8fb3-4e28-bf20-aca3e3353f00 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:07.551220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385a774-8fb3-4e28-bf20-aca3e3353f00 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:07.618515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93ff7-4653-4988-947f-2336395d2927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:07.620743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93ff7-4653-4988-947f-2336395d2927 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:07.621682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93ff7-4653-4988-947f-2336395d2927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:07.622117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93ff7-4653-4988-947f-2336395d2927 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:07.623324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c93ff7-4653-4988-947f-2336395d2927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:07.625196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c93ff7-4653-4988-947f-2336395d2927 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:07.738904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:07.745806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1045/2114] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:47:07 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:47:07.750504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f339d0-eb7a-4dec-940a-9db2f5760d70 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:07.761281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f339d0-eb7a-4dec-940a-9db2f5760d70 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:07.766265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c6a4-cbb0-4264-a7d4-e0a3667c4a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:07.766924 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c6a4-cbb0-4264-a7d4-e0a3667c4a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:07.767207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c6a4-cbb0-4264-a7d4-e0a3667c4a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:07.767480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c6a4-cbb0-4264-a7d4-e0a3667c4a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:07.768204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21c6a4-cbb0-4264-a7d4-e0a3667c4a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:07.769832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21c6a4-cbb0-4264-a7d4-e0a3667c4a22 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:07.781027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1070/2115] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:47:07.785098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93ff7-4653-4988-947f-2336395d2927 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:07.795370 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93ff7-4653-4988-947f-2336395d2927 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:07.801064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8b652-69a8-4112-86a3-300f160e3fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:07.801780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8b652-69a8-4112-86a3-300f160e3fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:07.802062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8b652-69a8-4112-86a3-300f160e3fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:07.802332 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8b652-69a8-4112-86a3-300f160e3fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:07.803534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8b652-69a8-4112-86a3-300f160e3fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:07.805867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8b652-69a8-4112-86a3-300f160e3fe6 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:07.817628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1046/2116] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:47:07.822123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c6a4-cbb0-4264-a7d4-e0a3667c4a22 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:07.832970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c6a4-cbb0-4264-a7d4-e0a3667c4a22 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:07.837800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f97d88-64eb-49ab-b6df-82d3d27be8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:07.838707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f97d88-64eb-49ab-b6df-82d3d27be8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:07.839266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f97d88-64eb-49ab-b6df-82d3d27be8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:07.839380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f97d88-64eb-49ab-b6df-82d3d27be8dd admin admin] PATH_INFO: `/v3/projects/7ae3a1ad9e76450ca81346013356d45a/users/a51e78e6d199400ab3bca655ad0d8da9/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:07.853630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f97d88-64eb-49ab-b6df-82d3d27be8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae3a1ad9e76450ca81346013356d45a, user_id=a51e78e6d199400ab3bca655ad0d8da9, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:07.856347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f97d88-64eb-49ab-b6df-82d3d27be8dd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:07.916172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:07.922696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1071/2117] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:47:07 2022] PUT /identity/v3/projects/7ae3a1ad9e76450ca81346013356d45a/users/a51e78e6d199400ab3bca655ad0d8da9/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:07.933778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa5090-4e46-4cd6-8a16-e2be04026ae9 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:07.934068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa5090-4e46-4cd6-8a16-e2be04026ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:07.934347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa5090-4e46-4cd6-8a16-e2be04026ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:07.962881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0ffa5090-4e46-4cd6-8a16-e2be04026ae9 None None] MFA Rules not processed for user `a51e78e6d199400ab3bca655ad0d8da9`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:07.964088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0ffa5090-4e46-4cd6-8a16-e2be04026ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:08.030074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1047/2118] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:08.034589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f97d88-64eb-49ab-b6df-82d3d27be8dd admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:08.098216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f97d88-64eb-49ab-b6df-82d3d27be8dd admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:08.102857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc750d55-959d-4f41-a6a3-6c7e4100da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:08.103505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc750d55-959d-4f41-a6a3-6c7e4100da66 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:08.104066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc750d55-959d-4f41-a6a3-6c7e4100da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:08.104066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc750d55-959d-4f41-a6a3-6c7e4100da66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:08.105545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc750d55-959d-4f41-a6a3-6c7e4100da66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:08.107491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc750d55-959d-4f41-a6a3-6c7e4100da66 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:08.209928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1072/2119] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:47:08 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:47:08.214107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa5090-4e46-4cd6-8a16-e2be04026ae9 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:08.225122 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa5090-4e46-4cd6-8a16-e2be04026ae9 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:08.282759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9451a0-b86c-4ca6-a9d7-6232e064fa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:08.283423 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9451a0-b86c-4ca6-a9d7-6232e064fa52 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:08.283707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9451a0-b86c-4ca6-a9d7-6232e064fa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:08.283982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9451a0-b86c-4ca6-a9d7-6232e064fa52 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:08.284806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9451a0-b86c-4ca6-a9d7-6232e064fa52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:08.286718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9451a0-b86c-4ca6-a9d7-6232e064fa52 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:08.321764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:08.381646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1048/2120] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:47:08 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:47:08.383040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc750d55-959d-4f41-a6a3-6c7e4100da66 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:08.394919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc750d55-959d-4f41-a6a3-6c7e4100da66 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:08.401696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9852905-ba92-4706-8234-b855791772e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:08.402465 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9852905-ba92-4706-8234-b855791772e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:08.402883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9852905-ba92-4706-8234-b855791772e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:08.403171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9852905-ba92-4706-8234-b855791772e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:08.403906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9852905-ba92-4706-8234-b855791772e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:08.405608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9852905-ba92-4706-8234-b855791772e6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:08.420191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1073/2121] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:47:08.421433 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9451a0-b86c-4ca6-a9d7-6232e064fa52 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:08.436945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9451a0-b86c-4ca6-a9d7-6232e064fa52 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:08.441400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ff9c1-ff44-40ec-a275-3d4db2611588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:08.442072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ff9c1-ff44-40ec-a275-3d4db2611588 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:08.442373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ff9c1-ff44-40ec-a275-3d4db2611588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:08.442653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ff9c1-ff44-40ec-a275-3d4db2611588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:08.443411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ff9c1-ff44-40ec-a275-3d4db2611588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:08.445082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ff9c1-ff44-40ec-a275-3d4db2611588 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:08.457064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1049/2122] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:47:08.462164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9852905-ba92-4706-8234-b855791772e6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:08.471479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:08.474921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9852905-ba92-4706-8234-b855791772e6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:08.480766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8a54c-6299-4c48-88e1-4208ced359f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:08.481414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8a54c-6299-4c48-88e1-4208ced359f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:08.481961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8a54c-6299-4c48-88e1-4208ced359f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:08.482154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8a54c-6299-4c48-88e1-4208ced359f4 admin admin] PATH_INFO: `/v3/projects/19aa80970ef34b3b9d89e1a8e443e934/users/1cc3d7b7d14145c28bf38ec43c8f92e7/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:08.507858 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8a54c-6299-4c48-88e1-4208ced359f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19aa80970ef34b3b9d89e1a8e443e934, user_id=1cc3d7b7d14145c28bf38ec43c8f92e7, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:08.511108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8a54c-6299-4c48-88e1-4208ced359f4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:08.619232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1074/2123] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:47:08 2022] PUT /identity/v3/projects/19aa80970ef34b3b9d89e1a8e443e934/users/1cc3d7b7d14145c28bf38ec43c8f92e7/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:08.630506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c825d5a-162a-46bf-8407-4cb94d7ed8a7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:08.631029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c825d5a-162a-46bf-8407-4cb94d7ed8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:08.636500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c825d5a-162a-46bf-8407-4cb94d7ed8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:08.660180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9c825d5a-162a-46bf-8407-4cb94d7ed8a7 None None] MFA Rules not processed for user `1cc3d7b7d14145c28bf38ec43c8f92e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:08.661400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9c825d5a-162a-46bf-8407-4cb94d7ed8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:08.729420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1050/2124] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:08.734263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:08.737502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8a54c-6299-4c48-88e1-4208ced359f4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:08.800262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8a54c-6299-4c48-88e1-4208ced359f4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:08.804927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bc795-f335-4f64-bd2a-feb613f5ddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:08.805576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bc795-f335-4f64-bd2a-feb613f5ddba admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:08.805857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bc795-f335-4f64-bd2a-feb613f5ddba admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:08.808047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bc795-f335-4f64-bd2a-feb613f5ddba admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:08.808047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bc795-f335-4f64-bd2a-feb613f5ddba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:08.808751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bc795-f335-4f64-bd2a-feb613f5ddba admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:08.841876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:08.886826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1075/2125] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:47:08 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:47:08.889439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c825d5a-162a-46bf-8407-4cb94d7ed8a7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:08.900490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c825d5a-162a-46bf-8407-4cb94d7ed8a7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:08.950507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:08.955908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92e38c-3a85-4eb1-a697-b57880901214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:08.957620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92e38c-3a85-4eb1-a697-b57880901214 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:08.957620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92e38c-3a85-4eb1-a697-b57880901214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:08.957620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92e38c-3a85-4eb1-a697-b57880901214 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:08.957939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92e38c-3a85-4eb1-a697-b57880901214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:08.959897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92e38c-3a85-4eb1-a697-b57880901214 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:09.044196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1051/2126] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:47:08 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:47:09.045516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bc795-f335-4f64-bd2a-feb613f5ddba admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:09.056196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bc795-f335-4f64-bd2a-feb613f5ddba admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:09.061681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508b5bd-d803-4cbb-a420-3b0bd5f61c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:09.062408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508b5bd-d803-4cbb-a420-3b0bd5f61c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:09.062700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508b5bd-d803-4cbb-a420-3b0bd5f61c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:09.062982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508b5bd-d803-4cbb-a420-3b0bd5f61c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:09.063713 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508b5bd-d803-4cbb-a420-3b0bd5f61c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:09.065364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508b5bd-d803-4cbb-a420-3b0bd5f61c1e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:09.077626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1076/2127] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:47:09.082116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92e38c-3a85-4eb1-a697-b57880901214 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:09.092131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92e38c-3a85-4eb1-a697-b57880901214 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:09.096072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:09.100220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c92a7-47c7-4e89-a3b6-0191284c17cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:09.101116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c92a7-47c7-4e89-a3b6-0191284c17cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:09.101481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c92a7-47c7-4e89-a3b6-0191284c17cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:09.101665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c92a7-47c7-4e89-a3b6-0191284c17cc admin admin] PATH_INFO: `/v3/projects/b32d11f2be544577bfdf6d8504a165af/users/a4c6f7f948bd4dcaa3d47b33625a1505/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:09.118035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c92a7-47c7-4e89-a3b6-0191284c17cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32d11f2be544577bfdf6d8504a165af, user_id=a4c6f7f948bd4dcaa3d47b33625a1505, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:09.121514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c92a7-47c7-4e89-a3b6-0191284c17cc admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:09.190393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:09.190932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1052/2128] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:47:09 2022] PUT /identity/v3/projects/b32d11f2be544577bfdf6d8504a165af/users/a4c6f7f948bd4dcaa3d47b33625a1505/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:09.194799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508b5bd-d803-4cbb-a420-3b0bd5f61c1e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:09.205920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508b5bd-d803-4cbb-a420-3b0bd5f61c1e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:09.266189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea72d43-db2e-4789-b759-d1df377cb84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:09.266880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea72d43-db2e-4789-b759-d1df377cb84a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:09.267184 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea72d43-db2e-4789-b759-d1df377cb84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:09.267461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea72d43-db2e-4789-b759-d1df377cb84a admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:09.268214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea72d43-db2e-4789-b759-d1df377cb84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:09.269838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea72d43-db2e-4789-b759-d1df377cb84a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:09.280612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1077/2129] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:47:09.284560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c92a7-47c7-4e89-a3b6-0191284c17cc admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:09.294870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c92a7-47c7-4e89-a3b6-0191284c17cc admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:09.299542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06544-2768-4515-bc95-c7b28970d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:09.305443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06544-2768-4515-bc95-c7b28970d4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:09.305443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06544-2768-4515-bc95-c7b28970d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:09.305443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06544-2768-4515-bc95-c7b28970d4d3 admin admin] PATH_INFO: `/v3/projects/b32d11f2be544577bfdf6d8504a165af/users/a4c6f7f948bd4dcaa3d47b33625a1505/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:09.305443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d06544-2768-4515-bc95-c7b28970d4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32d11f2be544577bfdf6d8504a165af, user_id=a4c6f7f948bd4dcaa3d47b33625a1505, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:09.305804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d06544-2768-4515-bc95-c7b28970d4d3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:09.319606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1053/2130] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:47:09 2022] PUT /identity/v3/projects/b32d11f2be544577bfdf6d8504a165af/users/a4c6f7f948bd4dcaa3d47b33625a1505/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:09.331872 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610e845-5e6d-488b-8c89-6827286ca6cb None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:09.332194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610e845-5e6d-488b-8c89-6827286ca6cb None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:09.332511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610e845-5e6d-488b-8c89-6827286ca6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:09.359301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d610e845-5e6d-488b-8c89-6827286ca6cb None None] MFA Rules not processed for user `a4c6f7f948bd4dcaa3d47b33625a1505`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:09.360548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d610e845-5e6d-488b-8c89-6827286ca6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:09.373054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:09.430100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1078/2131] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:09.449131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06544-2768-4515-bc95-c7b28970d4d3 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:09.449131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-48d06544-2768-4515-bc95-c7b28970d4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:09.469288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:09.505838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06544-2768-4515-bc95-c7b28970d4d3 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:09.509500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6020d81-e00e-427a-9f1c-a90d6154747e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:09.510146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6020d81-e00e-427a-9f1c-a90d6154747e service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:09.510488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6020d81-e00e-427a-9f1c-a90d6154747e service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:09.512391 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6020d81-e00e-427a-9f1c-a90d6154747e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:09.570986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6020d81-e00e-427a-9f1c-a90d6154747e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:09.572829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6020d81-e00e-427a-9f1c-a90d6154747e service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:09.582260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1054/2132] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:47:09.639303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=22,keystone:SELECT=76,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:09.909609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:10.112396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:10.275922 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:10.521941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:10.555916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:10.812825 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:10.978691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=18,keystone:SELECT=79,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:11.091967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:11.160765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:11.184805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:11.298660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:11.390236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:11.407139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:11.475821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:11.515646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:11.561610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:19.382656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610e845-5e6d-488b-8c89-6827286ca6cb None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:19.393999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610e845-5e6d-488b-8c89-6827286ca6cb None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:19.397563 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377396ab-c352-4233-ad12-ec6cd8cef11f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:19.398201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377396ab-c352-4233-ad12-ec6cd8cef11f service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:19.398645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377396ab-c352-4233-ad12-ec6cd8cef11f service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:19.398930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377396ab-c352-4233-ad12-ec6cd8cef11f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:19.400843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-377396ab-c352-4233-ad12-ec6cd8cef11f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:19.466303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377396ab-c352-4233-ad12-ec6cd8cef11f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:19.467755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377396ab-c352-4233-ad12-ec6cd8cef11f service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:19.477638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1079/2133] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:47:21.098083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6020d81-e00e-427a-9f1c-a90d6154747e service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:21.099500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a6020d81-e00e-427a-9f1c-a90d6154747e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:21.111223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6020d81-e00e-427a-9f1c-a90d6154747e service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:21.115073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bccb9-798a-4f02-ac73-d70baa85e7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:21.115749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bccb9-798a-4f02-ac73-d70baa85e7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:21.115999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bccb9-798a-4f02-ac73-d70baa85e7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:21.116273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bccb9-798a-4f02-ac73-d70baa85e7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:21.175127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bccb9-798a-4f02-ac73-d70baa85e7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:21.176603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bccb9-798a-4f02-ac73-d70baa85e7c1 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:21.185699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1055/2134] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:47:27.894031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377396ab-c352-4233-ad12-ec6cd8cef11f service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:27.902538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377396ab-c352-4233-ad12-ec6cd8cef11f service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:27.906715 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5f0f6-2a43-4352-993a-a3af049938a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:27.907357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5f0f6-2a43-4352-993a-a3af049938a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:27.907645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5f0f6-2a43-4352-993a-a3af049938a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:27.907930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5f0f6-2a43-4352-993a-a3af049938a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:27.917304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5f0f6-2a43-4352-993a-a3af049938a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:27.918741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5f0f6-2a43-4352-993a-a3af049938a8 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:27.928937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1080/2135] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:47:31.181396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=84,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:37.924579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=80 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:42.394963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bccb9-798a-4f02-ac73-d70baa85e7c1 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:42.475283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bccb9-798a-4f02-ac73-d70baa85e7c1 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:42.479831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:42.480736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:42.481012 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:42.481284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] PATH_INFO: `/v3/users/a51e78e6d199400ab3bca655ad0d8da9` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:42.482455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51e78e6d199400ab3bca655ad0d8da9)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:42.484407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:42.677257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51e78e6d199400ab3bca655ad0d8da9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:42.677924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51e78e6d199400ab3bca655ad0d8da9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:42.685844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51e78e6d199400ab3bca655ad0d8da9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:42.699283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51e78e6d199400ab3bca655ad0d8da9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:42.757266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51e78e6d199400ab3bca655ad0d8da9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:42.763731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1056/2136] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:42 2022] DELETE /identity/v3/users/a51e78e6d199400ab3bca655ad0d8da9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:42.772415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b053-a247-4455-8878-94234f4a4805 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:42.772911 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b053-a247-4455-8878-94234f4a4805 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:42.773028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b053-a247-4455-8878-94234f4a4805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:42.800432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-44a9b053-a247-4455-8878-94234f4a4805 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:47:42.801628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-44a9b053-a247-4455-8878-94234f4a4805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:42.858068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1081/2137] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:47:42.868494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:42.869914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:42.939388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:42.947621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a392-9c3e-47e2-b196-4010c91cf8f5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:42.952768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b9641-4ac8-45d1-9c74-9e5fd1c90453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:42.952768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b9641-4ac8-45d1-9c74-9e5fd1c90453 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:42.952768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b9641-4ac8-45d1-9c74-9e5fd1c90453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:42.952768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b9641-4ac8-45d1-9c74-9e5fd1c90453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:42.962043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b9641-4ac8-45d1-9c74-9e5fd1c90453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:42.963480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b9641-4ac8-45d1-9c74-9e5fd1c90453 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:42.973761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1057/2138] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:47:43.365719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9b053-a247-4455-8878-94234f4a4805 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:43.365719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-44a9b053-a247-4455-8878-94234f4a4805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:43.377313 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9b053-a247-4455-8878-94234f4a4805 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:43.383581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:43.384542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:43.392398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:43.392398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] PATH_INFO: `/v3/projects/7ae3a1ad9e76450ca81346013356d45a` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:43.392398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae3a1ad9e76450ca81346013356d45a)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:43.392398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:43.488326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae3a1ad9e76450ca81346013356d45a', 'request_id': 'req-3e173f14-2754-4f8f-9d6f-077957c4865e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.493643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae3a1ad9e76450ca81346013356d45a', 'request_id': 'req-3e173f14-2754-4f8f-9d6f-077957c4865e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.540280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae3a1ad9e76450ca81346013356d45a', 'request_id': 'req-3e173f14-2754-4f8f-9d6f-077957c4865e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.552195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] The token cache is being invalidate because project 7ae3a1ad9e76450ca81346013356d45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:43.552905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.553338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.554955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1082/2139] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:43 2022] DELETE /identity/v3/projects/7ae3a1ad9e76450ca81346013356d45a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:47:43.558881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b9641-4ac8-45d1-9c74-9e5fd1c90453 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:43.569783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b9641-4ac8-45d1-9c74-9e5fd1c90453 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:43.626725 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:43.627698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:43.627980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:43.628315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] PATH_INFO: `/v3/users/1cc3d7b7d14145c28bf38ec43c8f92e7` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:43.629551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc3d7b7d14145c28bf38ec43c8f92e7)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:43.631515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:43.846660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc3d7b7d14145c28bf38ec43c8f92e7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.847409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc3d7b7d14145c28bf38ec43c8f92e7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.854425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc3d7b7d14145c28bf38ec43c8f92e7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.868418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc3d7b7d14145c28bf38ec43c8f92e7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.923522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc3d7b7d14145c28bf38ec43c8f92e7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:43.930060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1058/2140] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:43 2022] DELETE /identity/v3/users/1cc3d7b7d14145c28bf38ec43c8f92e7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:44.334873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:44.336427 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:44.349870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173f14-2754-4f8f-9d6f-077957c4865e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:44.414444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:44.415302 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:44.415583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:44.415861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] PATH_INFO: `/v3/projects/19aa80970ef34b3b9d89e1a8e443e934` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:44.417173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=19aa80970ef34b3b9d89e1a8e443e934)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:44.418967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:44.441361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:44.545725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19aa80970ef34b3b9d89e1a8e443e934', 'request_id': 'req-6f252a7d-a1f3-4b4d-98f4-497295b19abe'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.552039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19aa80970ef34b3b9d89e1a8e443e934', 'request_id': 'req-6f252a7d-a1f3-4b4d-98f4-497295b19abe'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.642808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19aa80970ef34b3b9d89e1a8e443e934', 'request_id': 'req-6f252a7d-a1f3-4b4d-98f4-497295b19abe'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.654566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] The token cache is being invalidate because project 19aa80970ef34b3b9d89e1a8e443e934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:44.654858 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.655491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.657095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1083/2141] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:44 2022] DELETE /identity/v3/projects/19aa80970ef34b3b9d89e1a8e443e934 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:44.661244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:44.662677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:44.676110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96201d9-28b1-44b9-876f-03bb918fdee5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:44.733143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:44.734107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:44.734523 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:44.734865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] PATH_INFO: `/v3/users/a4c6f7f948bd4dcaa3d47b33625a1505` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:44.736694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c6f7f948bd4dcaa3d47b33625a1505)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:44.738910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:44.743695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:44.891360 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c6f7f948bd4dcaa3d47b33625a1505'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.892049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c6f7f948bd4dcaa3d47b33625a1505'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.899033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c6f7f948bd4dcaa3d47b33625a1505'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.910848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c6f7f948bd4dcaa3d47b33625a1505'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.978846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-47373e31-4e8a-4569-a21b-9c9deec35c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c6f7f948bd4dcaa3d47b33625a1505'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:44.985569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1059/2142] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:47:44 2022] DELETE /identity/v3/users/a4c6f7f948bd4dcaa3d47b33625a1505 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:45.479829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:47:45.481570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:47:45.498843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f252a7d-a1f3-4b4d-98f4-497295b19abe admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:47:45.558171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:47:45.559032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:47:45.559317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:47:45.559595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] PATH_INFO: `/v3/projects/b32d11f2be544577bfdf6d8504a165af` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:47:45.560821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32d11f2be544577bfdf6d8504a165af)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:47:45.562789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:47:45.706261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32d11f2be544577bfdf6d8504a165af', 'request_id': 'req-3d28a6a4-462e-4e02-86f4-324599b034e0'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:45.712211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32d11f2be544577bfdf6d8504a165af', 'request_id': 'req-3d28a6a4-462e-4e02-86f4-324599b034e0'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:45.797114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32d11f2be544577bfdf6d8504a165af', 'request_id': 'req-3d28a6a4-462e-4e02-86f4-324599b034e0'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:45.809904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] The token cache is being invalidate because project b32d11f2be544577bfdf6d8504a165af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:47:45.811820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:45.811820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:47:45.812647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1084/2143] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:47:45 2022] DELETE /identity/v3/projects/b32d11f2be544577bfdf6d8504a165af => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:47:54.981518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:55.806682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:10.600359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adfdf1-f3f3-41ce-ab44-5b8ab78440e4 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:10.600898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adfdf1-f3f3-41ce-ab44-5b8ab78440e4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:10.601003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adfdf1-f3f3-41ce-ab44-5b8ab78440e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:10.620927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b1adfdf1-f3f3-41ce-ab44-5b8ab78440e4 None None] MFA Rules not processed for user `f14f77bc65fd4ff0bc1ec6de35846f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:10.622047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b1adfdf1-f3f3-41ce-ab44-5b8ab78440e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:10.677071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1060/2144] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:17.283330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:17.288838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:17.357681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28a6a4-462e-4e02-86f4-324599b034e0 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:17.362248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:17.363190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:17.363473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:17.363745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] PATH_INFO: `/v3/users/5b4185a498544c0ab1962645aa350eda` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:17.365031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4185a498544c0ab1962645aa350eda)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:17.367003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:17.556989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4185a498544c0ab1962645aa350eda'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:17.622471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4185a498544c0ab1962645aa350eda'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:17.623108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4185a498544c0ab1962645aa350eda'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:17.623797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4185a498544c0ab1962645aa350eda'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:17.633153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4185a498544c0ab1962645aa350eda'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:17.650203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1085/2145] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:48:17 2022] DELETE /identity/v3/users/5b4185a498544c0ab1962645aa350eda => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:17.655377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b2a8-e21b-4dc5-a22e-bb294bf7938a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:17.655873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b2a8-e21b-4dc5-a22e-bb294bf7938a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:17.656111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b2a8-e21b-4dc5-a22e-bb294bf7938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:17.676227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-eed0b2a8-e21b-4dc5-a22e-bb294bf7938a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:17.679124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-eed0b2a8-e21b-4dc5-a22e-bb294bf7938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:17.751618 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1061/2146] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:17.761817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:17.763481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:17.826258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d2bb5-69d0-4a16-92d8-52ecfb4d2d28 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:17.830446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce35ce-8f14-4508-b6e5-e3eb483dc464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:17.831386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce35ce-8f14-4508-b6e5-e3eb483dc464 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:17.831672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce35ce-8f14-4508-b6e5-e3eb483dc464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:17.831951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce35ce-8f14-4508-b6e5-e3eb483dc464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:17.842953 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce35ce-8f14-4508-b6e5-e3eb483dc464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:17.844494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce35ce-8f14-4508-b6e5-e3eb483dc464 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:17.856560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1086/2147] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:48:18.348795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b2a8-e21b-4dc5-a22e-bb294bf7938a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:18.349606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-eed0b2a8-e21b-4dc5-a22e-bb294bf7938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:18.365466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b2a8-e21b-4dc5-a22e-bb294bf7938a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:18.378204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:18.379090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:18.379381 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:18.379660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] PATH_INFO: `/v3/projects/d719495c4ff5447ea0f1c02a63c22ba3` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:18.380941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d719495c4ff5447ea0f1c02a63c22ba3)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:18.382870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:18.524068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd719495c4ff5447ea0f1c02a63c22ba3', 'request_id': 'req-5d667383-87d7-4c5b-a00b-850df365cd1f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:18.661648 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd719495c4ff5447ea0f1c02a63c22ba3', 'request_id': 'req-5d667383-87d7-4c5b-a00b-850df365cd1f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:18.669044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd719495c4ff5447ea0f1c02a63c22ba3', 'request_id': 'req-5d667383-87d7-4c5b-a00b-850df365cd1f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:18.679782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] The token cache is being invalidate because project d719495c4ff5447ea0f1c02a63c22ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:48:18.680070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:18.680948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:18.682524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1062/2148] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:48:18 2022] DELETE /identity/v3/projects/d719495c4ff5447ea0f1c02a63c22ba3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:18.687260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce35ce-8f14-4508-b6e5-e3eb483dc464 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:18.697037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce35ce-8f14-4508-b6e5-e3eb483dc464 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:18.718194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:18.757168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:18.758168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:18.758427 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:18.758708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] PATH_INFO: `/v3/users/d3475036f82243e689e3f06c6a0a8875` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:18.759893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3475036f82243e689e3f06c6a0a8875)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:18.762442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:18.953902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3475036f82243e689e3f06c6a0a8875'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.067473 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3475036f82243e689e3f06c6a0a8875'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.068159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3475036f82243e689e3f06c6a0a8875'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.068810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3475036f82243e689e3f06c6a0a8875'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.077333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-813db4ca-342c-492a-839e-b1153f5af0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3475036f82243e689e3f06c6a0a8875'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.096127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1087/2149] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:48:18 2022] DELETE /identity/v3/users/d3475036f82243e689e3f06c6a0a8875 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:19.579226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:19.582033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:19.604028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d667383-87d7-4c5b-a00b-850df365cd1f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:19.639174 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:19.678317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:19.679189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:19.679466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:19.679763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] PATH_INFO: `/v3/projects/80a117a2d82b4dd2997257aede1fca7f` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:19.681192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a117a2d82b4dd2997257aede1fca7f)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:19.683176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:19.798926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a117a2d82b4dd2997257aede1fca7f', 'request_id': 'req-a9e07f51-db78-4efb-9ba8-4d81002492b4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.876333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a117a2d82b4dd2997257aede1fca7f', 'request_id': 'req-a9e07f51-db78-4efb-9ba8-4d81002492b4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.882908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a117a2d82b4dd2997257aede1fca7f', 'request_id': 'req-a9e07f51-db78-4efb-9ba8-4d81002492b4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.894053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] The token cache is being invalidate because project 80a117a2d82b4dd2997257aede1fca7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:48:19.894188 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.895350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a9e07f51-db78-4efb-9ba8-4d81002492b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:19.897030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1063/2150] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:48:19 2022] DELETE /identity/v3/projects/80a117a2d82b4dd2997257aede1fca7f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:19.902771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5d756-5be7-4ab3-8dbe-17b002a543a3 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:19.902771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5d756-5be7-4ab3-8dbe-17b002a543a3 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:19.903392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5d756-5be7-4ab3-8dbe-17b002a543a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:19.951240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-f6e5d756-5be7-4ab3-8dbe-17b002a543a3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:19.952531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f6e5d756-5be7-4ab3-8dbe-17b002a543a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:20.015094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1088/2151] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:20.023518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace4905-cbe4-4991-81b6-0ec55146f486 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:20.023808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace4905-cbe4-4991-81b6-0ec55146f486 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:20.024135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace4905-cbe4-4991-81b6-0ec55146f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:20.042705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7ace4905-cbe4-4991-81b6-0ec55146f486 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:20.044628 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7ace4905-cbe4-4991-81b6-0ec55146f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:20.052403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1064/2152] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:20.056457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5d756-5be7-4ab3-8dbe-17b002a543a3 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:20.068924 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5d756-5be7-4ab3-8dbe-17b002a543a3 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:20.073972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e544f1-b4c8-4894-ab0b-67163ef2637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:20.074833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e544f1-b4c8-4894-ab0b-67163ef2637a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:20.075154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e544f1-b4c8-4894-ab0b-67163ef2637a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:20.075509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e544f1-b4c8-4894-ab0b-67163ef2637a admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:20.076285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e544f1-b4c8-4894-ab0b-67163ef2637a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:48:20.077416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e544f1-b4c8-4894-ab0b-67163ef2637a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:20.078304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e544f1-b4c8-4894-ab0b-67163ef2637a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:20.091687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1089/2153] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:48:20.096311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace4905-cbe4-4991-81b6-0ec55146f486 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:20.106248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace4905-cbe4-4991-81b6-0ec55146f486 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:20.111030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b76c-9fab-4d60-84a8-14f7f67cb325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:20.111679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b76c-9fab-4d60-84a8-14f7f67cb325 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:20.112016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b76c-9fab-4d60-84a8-14f7f67cb325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:20.112288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b76c-9fab-4d60-84a8-14f7f67cb325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:20.113053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798b76c-9fab-4d60-84a8-14f7f67cb325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:20.114960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798b76c-9fab-4d60-84a8-14f7f67cb325 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:20.223461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1065/2154] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:48:20 2022] POST /identity/v3/projects => generated 407 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:48:20.227516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e544f1-b4c8-4894-ab0b-67163ef2637a admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:20.234485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:20.239132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e544f1-b4c8-4894-ab0b-67163ef2637a admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:20.294195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4f8f3-8686-4a4d-9348-407e26f1516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:20.294857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4f8f3-8686-4a4d-9348-407e26f1516e admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:20.295143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4f8f3-8686-4a4d-9348-407e26f1516e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:20.295419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4f8f3-8686-4a4d-9348-407e26f1516e admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:20.296110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4f8f3-8686-4a4d-9348-407e26f1516e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:20.298149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4f8f3-8686-4a4d-9348-407e26f1516e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:20.414113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1090/2155] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:48:20 2022] POST /identity/v3/users => generated 304 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:20.419063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b76c-9fab-4d60-84a8-14f7f67cb325 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:20.429516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b76c-9fab-4d60-84a8-14f7f67cb325 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:20.435038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf9099-e398-4ef7-ac3c-4a7a48eb94c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:20.435939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf9099-e398-4ef7-ac3c-4a7a48eb94c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:20.436194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf9099-e398-4ef7-ac3c-4a7a48eb94c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:20.436576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf9099-e398-4ef7-ac3c-4a7a48eb94c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:20.437303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf9099-e398-4ef7-ac3c-4a7a48eb94c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:20.443426 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf9099-e398-4ef7-ac3c-4a7a48eb94c0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:20.456229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1066/2156] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:20.460483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4f8f3-8686-4a4d-9348-407e26f1516e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:20.470846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4f8f3-8686-4a4d-9348-407e26f1516e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:20.476607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea075f0e-5099-4ea0-a035-92f30cff2155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:20.477272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075f0e-5099-4ea0-a035-92f30cff2155 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:20.477565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075f0e-5099-4ea0-a035-92f30cff2155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:20.477977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075f0e-5099-4ea0-a035-92f30cff2155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:20.478724 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea075f0e-5099-4ea0-a035-92f30cff2155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:20.480881 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea075f0e-5099-4ea0-a035-92f30cff2155 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:20.491223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1091/2157] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:20.495366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf9099-e398-4ef7-ac3c-4a7a48eb94c0 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:20.506574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf9099-e398-4ef7-ac3c-4a7a48eb94c0 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:20.511704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede31cb0-e948-4fbd-85d4-027776e95001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:20.512765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede31cb0-e948-4fbd-85d4-027776e95001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:20.513119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede31cb0-e948-4fbd-85d4-027776e95001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:20.513405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede31cb0-e948-4fbd-85d4-027776e95001 admin admin] PATH_INFO: `/v3/projects/b9107cc53c8648999bea2e938bcb8e2b/users/b7244d0897184b45b34e03a3a6772cf8/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:20.529569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede31cb0-e948-4fbd-85d4-027776e95001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9107cc53c8648999bea2e938bcb8e2b, user_id=b7244d0897184b45b34e03a3a6772cf8, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:20.532504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede31cb0-e948-4fbd-85d4-027776e95001 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:20.643110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1067/2158] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:20 2022] PUT /identity/v3/projects/b9107cc53c8648999bea2e938bcb8e2b/users/b7244d0897184b45b34e03a3a6772cf8/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:48:20.653556 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337547dc-4a30-462c-a575-79e72a57a035 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:20.653853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337547dc-4a30-462c-a575-79e72a57a035 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:20.654141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337547dc-4a30-462c-a575-79e72a57a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:20.687064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-337547dc-4a30-462c-a575-79e72a57a035 None None] MFA Rules not processed for user `b7244d0897184b45b34e03a3a6772cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:20.688330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-337547dc-4a30-462c-a575-79e72a57a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:20.760759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1092/2159] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:20.766989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede31cb0-e948-4fbd-85d4-027776e95001 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:20.823401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:20.828483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede31cb0-e948-4fbd-85d4-027776e95001 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:20.833403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e405ef-cb38-4670-ba87-b30f475f706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:20.834136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e405ef-cb38-4670-ba87-b30f475f706f admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:20.834363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e405ef-cb38-4670-ba87-b30f475f706f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:20.834637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e405ef-cb38-4670-ba87-b30f475f706f admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:20.835318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e405ef-cb38-4670-ba87-b30f475f706f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:20.837267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e405ef-cb38-4670-ba87-b30f475f706f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:20.945081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1068/2160] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:48:20 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:20.946285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337547dc-4a30-462c-a575-79e72a57a035 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:20.957560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337547dc-4a30-462c-a575-79e72a57a035 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:21.014874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512abd8c-6ba3-4f63-9962-2d4b43903e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:21.015544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512abd8c-6ba3-4f63-9962-2d4b43903e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:21.015832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512abd8c-6ba3-4f63-9962-2d4b43903e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:21.016117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512abd8c-6ba3-4f63-9962-2d4b43903e6d admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:21.016843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512abd8c-6ba3-4f63-9962-2d4b43903e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:21.018766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512abd8c-6ba3-4f63-9962-2d4b43903e6d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:21.119028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1093/2161] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:48:20 2022] POST /identity/v3/users => generated 309 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:21.123018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e405ef-cb38-4670-ba87-b30f475f706f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:21.133253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e405ef-cb38-4670-ba87-b30f475f706f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:21.138353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb61eb-cb1e-42dc-8131-5204a0bfe1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:21.139004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb61eb-cb1e-42dc-8131-5204a0bfe1db admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:21.139286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb61eb-cb1e-42dc-8131-5204a0bfe1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:21.139565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb61eb-cb1e-42dc-8131-5204a0bfe1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:21.140288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb61eb-cb1e-42dc-8131-5204a0bfe1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:21.141937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb61eb-cb1e-42dc-8131-5204a0bfe1db admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:21.153277 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1069/2162] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:21.157116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512abd8c-6ba3-4f63-9962-2d4b43903e6d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:21.162243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:21.167438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512abd8c-6ba3-4f63-9962-2d4b43903e6d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:21.172483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bf1d7-12fe-47b6-8959-f5a5146e921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:21.173381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bf1d7-12fe-47b6-8959-f5a5146e921b admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:21.173665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bf1d7-12fe-47b6-8959-f5a5146e921b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:21.173941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bf1d7-12fe-47b6-8959-f5a5146e921b admin admin] PATH_INFO: `/v3/projects/fb066458aed146289201579a63c8b07e/users/a04fa6a9f74d4c8794eecadc83495c75/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:21.189462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bf1d7-12fe-47b6-8959-f5a5146e921b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb066458aed146289201579a63c8b07e, user_id=a04fa6a9f74d4c8794eecadc83495c75, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:21.192123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bf1d7-12fe-47b6-8959-f5a5146e921b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:21.280345 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1094/2163] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:21 2022] PUT /identity/v3/projects/fb066458aed146289201579a63c8b07e/users/a04fa6a9f74d4c8794eecadc83495c75/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:48:21.284402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb61eb-cb1e-42dc-8131-5204a0bfe1db admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:21.295593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb61eb-cb1e-42dc-8131-5204a0bfe1db admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:21.352313 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35dece-420b-4094-8cd5-6e2c6da6afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:21.352987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35dece-420b-4094-8cd5-6e2c6da6afc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:21.353271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35dece-420b-4094-8cd5-6e2c6da6afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:21.353607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35dece-420b-4094-8cd5-6e2c6da6afc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:21.354326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35dece-420b-4094-8cd5-6e2c6da6afc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:21.356498 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35dece-420b-4094-8cd5-6e2c6da6afc3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:21.366488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1070/2164] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:21.370689 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bf1d7-12fe-47b6-8959-f5a5146e921b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:21.381755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bf1d7-12fe-47b6-8959-f5a5146e921b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:21.386351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1303-2079-4458-a452-932907d520a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:21.387246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1303-2079-4458-a452-932907d520a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:21.387525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1303-2079-4458-a452-932907d520a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:21.387800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1303-2079-4458-a452-932907d520a1 admin admin] PATH_INFO: `/v3/projects/fb066458aed146289201579a63c8b07e/users/a04fa6a9f74d4c8794eecadc83495c75/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:21.389846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b1303-2079-4458-a452-932907d520a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb066458aed146289201579a63c8b07e, user_id=a04fa6a9f74d4c8794eecadc83495c75, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:21.392526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b1303-2079-4458-a452-932907d520a1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:21.402970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1095/2165] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:21 2022] PUT /identity/v3/projects/fb066458aed146289201579a63c8b07e/users/a04fa6a9f74d4c8794eecadc83495c75/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:21.416537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a358036-7175-431b-80f0-c3bf7e250c6e None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:21.416829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a358036-7175-431b-80f0-c3bf7e250c6e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:21.417110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a358036-7175-431b-80f0-c3bf7e250c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:21.444502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9a358036-7175-431b-80f0-c3bf7e250c6e None None] MFA Rules not processed for user `a04fa6a9f74d4c8794eecadc83495c75`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:21.445643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9a358036-7175-431b-80f0-c3bf7e250c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:21.520903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1071/2166] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:21.533376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1303-2079-4458-a452-932907d520a1 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:21.535075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8e7b1303-2079-4458-a452-932907d520a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:21.616241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1303-2079-4458-a452-932907d520a1 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:21.620328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613d6a8-a074-4996-9f71-0c5a5351ceb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:21.621029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613d6a8-a074-4996-9f71-0c5a5351ceb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:21.621891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613d6a8-a074-4996-9f71-0c5a5351ceb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:21.621891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613d6a8-a074-4996-9f71-0c5a5351ceb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:21.631782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613d6a8-a074-4996-9f71-0c5a5351ceb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:21.633258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613d6a8-a074-4996-9f71-0c5a5351ceb1 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:21.644759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1096/2167] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:21 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:22.007050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a358036-7175-431b-80f0-c3bf7e250c6e None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:22.008622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9a358036-7175-431b-80f0-c3bf7e250c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:22.040133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613d6a8-a074-4996-9f71-0c5a5351ceb1 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:22.049879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613d6a8-a074-4996-9f71-0c5a5351ceb1 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:22.053829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d8c10-b337-430d-b277-7d34d31de852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:22.054229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d8c10-b337-430d-b277-7d34d31de852 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:22.054570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d8c10-b337-430d-b277-7d34d31de852 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:22.054855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d8c10-b337-430d-b277-7d34d31de852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:22.064873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:22.079565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a358036-7175-431b-80f0-c3bf7e250c6e None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:22.084457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:22.085329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:22.085605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:22.085877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] PATH_INFO: `/v3/users/9c50f83286304d438f0a578fa2964708` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:22.087060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c50f83286304d438f0a578fa2964708)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:22.089140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:22.116393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d8c10-b337-430d-b277-7d34d31de852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:22.117870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d8c10-b337-430d-b277-7d34d31de852 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:22.127368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1097/2168] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:48:22.342743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c50f83286304d438f0a578fa2964708'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:22.343429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c50f83286304d438f0a578fa2964708'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:22.350314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c50f83286304d438f0a578fa2964708'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:22.362601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c50f83286304d438f0a578fa2964708'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:22.425399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c50f83286304d438f0a578fa2964708'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:22.431595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1072/2169] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:48:22 2022] DELETE /identity/v3/users/9c50f83286304d438f0a578fa2964708 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:22.436068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311b78e-08d2-4c9e-b40b-6c9e73e3f768 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:22.440528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311b78e-08d2-4c9e-b40b-6c9e73e3f768 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:22.440528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311b78e-08d2-4c9e-b40b-6c9e73e3f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:22.454061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-a311b78e-08d2-4c9e-b40b-6c9e73e3f768 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:22.455257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a311b78e-08d2-4c9e-b40b-6c9e73e3f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:22.503718 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:22.521720 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1098/2170] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:22.531654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:22.533101 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:22.593976 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb09c83-fd13-43e4-8bcb-46fc5531a2f8 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:22.597515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b4706-7d4a-4c35-8e71-7544021df502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:22.598166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b4706-7d4a-4c35-8e71-7544021df502 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:22.598451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b4706-7d4a-4c35-8e71-7544021df502 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:22.598731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b4706-7d4a-4c35-8e71-7544021df502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:22.608418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b4706-7d4a-4c35-8e71-7544021df502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:22.609866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b4706-7d4a-4c35-8e71-7544021df502 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:22.619294 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1073/2171] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:23.086415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311b78e-08d2-4c9e-b40b-6c9e73e3f768 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:23.087957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a311b78e-08d2-4c9e-b40b-6c9e73e3f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:23.105116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311b78e-08d2-4c9e-b40b-6c9e73e3f768 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:23.111304 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:23.113084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:23.113084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:23.113084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] PATH_INFO: `/v3/projects/fe3c92bea76045d29a2884ee473c42cc` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:23.114310 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3c92bea76045d29a2884ee473c42cc)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:23.116395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:23.240416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3c92bea76045d29a2884ee473c42cc', 'request_id': 'req-ea2cd13c-bbf0-4cbb-9796-0399920961aa'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:23.246237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3c92bea76045d29a2884ee473c42cc', 'request_id': 'req-ea2cd13c-bbf0-4cbb-9796-0399920961aa'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:23.307503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3c92bea76045d29a2884ee473c42cc', 'request_id': 'req-ea2cd13c-bbf0-4cbb-9796-0399920961aa'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:23.318868 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] The token cache is being invalidate because project fe3c92bea76045d29a2884ee473c42cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:48:23.319152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:23.319770 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea2cd13c-bbf0-4cbb-9796-0399920961aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:23.321339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1099/2172] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:48:23 2022] DELETE /identity/v3/projects/fe3c92bea76045d29a2884ee473c42cc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:23.900392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b4706-7d4a-4c35-8e71-7544021df502 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:23.901845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7c4b4706-7d4a-4c35-8e71-7544021df502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:23.915133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b4706-7d4a-4c35-8e71-7544021df502 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:23.983540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:23.984452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:23.984739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:23.985021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] PATH_INFO: `/v3/users/639582f6e4db49adb163cc0ec279429c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:23.986269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=639582f6e4db49adb163cc0ec279429c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:23.988205 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:24.007674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:24.178476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639582f6e4db49adb163cc0ec279429c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:24.179157 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639582f6e4db49adb163cc0ec279429c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:24.186481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639582f6e4db49adb163cc0ec279429c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:24.199292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639582f6e4db49adb163cc0ec279429c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:24.290268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639582f6e4db49adb163cc0ec279429c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:24.297684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1074/2173] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:48:23 2022] DELETE /identity/v3/users/639582f6e4db49adb163cc0ec279429c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:24.302279 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b426b6-f9cd-44c5-9995-a731f9305d56 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:24.302787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b426b6-f9cd-44c5-9995-a731f9305d56 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:24.302885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b426b6-f9cd-44c5-9995-a731f9305d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:24.322336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-53b426b6-f9cd-44c5-9995-a731f9305d56 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:24.323571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-53b426b6-f9cd-44c5-9995-a731f9305d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:24.386967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1100/2174] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:24.396861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:24.398326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:24.482632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9853-62d8-4742-b6d4-343281238065 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:24.486378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e63a3-1e00-4456-bbcb-0acd7df1268b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:24.487029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e63a3-1e00-4456-bbcb-0acd7df1268b service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:24.487315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e63a3-1e00-4456-bbcb-0acd7df1268b service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:24.487592 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e63a3-1e00-4456-bbcb-0acd7df1268b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:24.496745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e63a3-1e00-4456-bbcb-0acd7df1268b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:24.498434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e63a3-1e00-4456-bbcb-0acd7df1268b service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:24.507861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1075/2175] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:24.913140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b426b6-f9cd-44c5-9995-a731f9305d56 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:24.914573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-53b426b6-f9cd-44c5-9995-a731f9305d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:24.927103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b426b6-f9cd-44c5-9995-a731f9305d56 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:24.931794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:24.932807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:24.933093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:24.933369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] PATH_INFO: `/v3/projects/13f5566adafe47c2ad04f3279d1bd76a` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:24.934591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f5566adafe47c2ad04f3279d1bd76a)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:24.936816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:25.055757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f5566adafe47c2ad04f3279d1bd76a', 'request_id': 'req-f5bc6dc5-67d8-4812-9a76-174816b46353'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:25.061267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f5566adafe47c2ad04f3279d1bd76a', 'request_id': 'req-f5bc6dc5-67d8-4812-9a76-174816b46353'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:25.142026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f5566adafe47c2ad04f3279d1bd76a', 'request_id': 'req-f5bc6dc5-67d8-4812-9a76-174816b46353'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:25.143416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:25.155062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] The token cache is being invalidate because project 13f5566adafe47c2ad04f3279d1bd76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:48:25.155359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:25.156000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f5bc6dc5-67d8-4812-9a76-174816b46353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:25.157691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1101/2176] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:48:24 2022] DELETE /identity/v3/projects/13f5566adafe47c2ad04f3279d1bd76a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:25.162554 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb1675-6b0d-40b1-90f6-c47d4a6ef531 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.162997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb1675-6b0d-40b1-90f6-c47d4a6ef531 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.163264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb1675-6b0d-40b1-90f6-c47d4a6ef531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.182034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-11eb1675-6b0d-40b1-90f6-c47d4a6ef531 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:25.183349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-11eb1675-6b0d-40b1-90f6-c47d4a6ef531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:25.253350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1076/2177] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:25.261258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ba262-a289-43cb-a090-2adddf00cc21 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.261444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ba262-a289-43cb-a090-2adddf00cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.261728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ba262-a289-43cb-a090-2adddf00cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.280542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5f0ba262-a289-43cb-a090-2adddf00cc21 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:25.281756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5f0ba262-a289-43cb-a090-2adddf00cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:25.293300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1102/2178] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:25.294244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb1675-6b0d-40b1-90f6-c47d4a6ef531 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:25.304270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb1675-6b0d-40b1-90f6-c47d4a6ef531 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:25.309295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e848781-1359-4d83-a861-6b04f9003021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:25.310453 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e848781-1359-4d83-a861-6b04f9003021 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.310729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e848781-1359-4d83-a861-6b04f9003021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.311007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e848781-1359-4d83-a861-6b04f9003021 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.311738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e848781-1359-4d83-a861-6b04f9003021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:48:25.312049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e848781-1359-4d83-a861-6b04f9003021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:25.313688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e848781-1359-4d83-a861-6b04f9003021 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:25.326579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1077/2179] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:48:25.332635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ba262-a289-43cb-a090-2adddf00cc21 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:25.341754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ba262-a289-43cb-a090-2adddf00cc21 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:25.346469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec99dac-96f1-4d76-b5fe-a2f1750982d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:25.347119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec99dac-96f1-4d76-b5fe-a2f1750982d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.347410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec99dac-96f1-4d76-b5fe-a2f1750982d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.347692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec99dac-96f1-4d76-b5fe-a2f1750982d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.348416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec99dac-96f1-4d76-b5fe-a2f1750982d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:25.352252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec99dac-96f1-4d76-b5fe-a2f1750982d7 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:25.452629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1103/2180] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:48:25 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:25.457626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e848781-1359-4d83-a861-6b04f9003021 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:25.468353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e848781-1359-4d83-a861-6b04f9003021 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:25.487937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:25.526425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b73c8-301c-45cd-b464-68f6bb46c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:25.527124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b73c8-301c-45cd-b464-68f6bb46c2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.527409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b73c8-301c-45cd-b464-68f6bb46c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.527683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b73c8-301c-45cd-b464-68f6bb46c2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.528411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b73c8-301c-45cd-b464-68f6bb46c2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:25.530359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b73c8-301c-45cd-b464-68f6bb46c2f0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:25.611416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1078/2181] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:48:25 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:25.615595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec99dac-96f1-4d76-b5fe-a2f1750982d7 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:25.628031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec99dac-96f1-4d76-b5fe-a2f1750982d7 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:25.632808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fe962-62cd-44cd-ac57-94a8cfb50932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:25.633474 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fe962-62cd-44cd-ac57-94a8cfb50932 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.633764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fe962-62cd-44cd-ac57-94a8cfb50932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.634045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fe962-62cd-44cd-ac57-94a8cfb50932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.634774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fe962-62cd-44cd-ac57-94a8cfb50932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:25.636421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fe962-62cd-44cd-ac57-94a8cfb50932 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:25.646712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1104/2182] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:25.650722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b73c8-301c-45cd-b464-68f6bb46c2f0 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:25.660749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b73c8-301c-45cd-b464-68f6bb46c2f0 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:25.665344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690de05-ceb8-4bb6-b7e9-941eaeb298ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:25.665993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690de05-ceb8-4bb6-b7e9-941eaeb298ee admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.666274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690de05-ceb8-4bb6-b7e9-941eaeb298ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.666550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690de05-ceb8-4bb6-b7e9-941eaeb298ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.667269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690de05-ceb8-4bb6-b7e9-941eaeb298ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:25.668891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690de05-ceb8-4bb6-b7e9-941eaeb298ee admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:25.679257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1079/2183] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:25.683248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fe962-62cd-44cd-ac57-94a8cfb50932 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:25.694421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fe962-62cd-44cd-ac57-94a8cfb50932 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:25.699218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e4de-db19-4959-95ef-c36706168489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:25.700169 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e4de-db19-4959-95ef-c36706168489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.700539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e4de-db19-4959-95ef-c36706168489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.701050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e4de-db19-4959-95ef-c36706168489 admin admin] PATH_INFO: `/v3/projects/6ac7266965604a2584f8332c693a8f99/users/cc62728bbc414e998c1ec612dad654eb/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.715903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101e4de-db19-4959-95ef-c36706168489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac7266965604a2584f8332c693a8f99, user_id=cc62728bbc414e998c1ec612dad654eb, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:25.719117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101e4de-db19-4959-95ef-c36706168489 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:25.785371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1105/2184] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:25 2022] PUT /identity/v3/projects/6ac7266965604a2584f8332c693a8f99/users/cc62728bbc414e998c1ec612dad654eb/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:48:25.797130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c58fd-d215-4ff0-9c35-4131bb2da9c1 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.797479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c58fd-d215-4ff0-9c35-4131bb2da9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.797763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c58fd-d215-4ff0-9c35-4131bb2da9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.824964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-259c58fd-d215-4ff0-9c35-4131bb2da9c1 None None] MFA Rules not processed for user `cc62728bbc414e998c1ec612dad654eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:25.826491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-259c58fd-d215-4ff0-9c35-4131bb2da9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:25.890613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1080/2185] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:25.901663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e4de-db19-4959-95ef-c36706168489 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:25.903369 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e101e4de-db19-4959-95ef-c36706168489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:25.962146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e4de-db19-4959-95ef-c36706168489 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:25.965749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2070-bbdd-430c-baec-eff986b0a6e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:25.967099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2070-bbdd-430c-baec-eff986b0a6e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:25.967379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2070-bbdd-430c-baec-eff986b0a6e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:25.967654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2070-bbdd-430c-baec-eff986b0a6e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:25.975957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2070-bbdd-430c-baec-eff986b0a6e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:25.977430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2070-bbdd-430c-baec-eff986b0a6e2 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:25.986681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1106/2186] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:26.010913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c58fd-d215-4ff0-9c35-4131bb2da9c1 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:26.073122 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c58fd-d215-4ff0-9c35-4131bb2da9c1 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:26.077918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:26.078783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:26.079069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:26.079347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] PATH_INFO: `/v3/users/cc62728bbc414e998c1ec612dad654eb` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:26.080573 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc62728bbc414e998c1ec612dad654eb)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:26.082753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:26.233678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:26.245693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc62728bbc414e998c1ec612dad654eb'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:26.246401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc62728bbc414e998c1ec612dad654eb'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:26.253291 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc62728bbc414e998c1ec612dad654eb'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:26.265081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc62728bbc414e998c1ec612dad654eb'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:26.327996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc62728bbc414e998c1ec612dad654eb'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:26.337684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1081/2187] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:48:26 2022] DELETE /identity/v3/users/cc62728bbc414e998c1ec612dad654eb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:26.339600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3f6c-199f-4f33-b79c-0d30d69acb32 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:26.340004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3f6c-199f-4f33-b79c-0d30d69acb32 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:26.340363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3f6c-199f-4f33-b79c-0d30d69acb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:26.359217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c61e3f6c-199f-4f33-b79c-0d30d69acb32 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:26.360477 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c61e3f6c-199f-4f33-b79c-0d30d69acb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:26.424553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1107/2188] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:26.433798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:26.435611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:26.506033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672c774-f3c2-49e6-b123-255eaa4bbc58 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:26.509736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538893a1-b9ef-4c9c-bc58-8ebc7e35b2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:26.510383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538893a1-b9ef-4c9c-bc58-8ebc7e35b2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:26.510665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538893a1-b9ef-4c9c-bc58-8ebc7e35b2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:26.510942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538893a1-b9ef-4c9c-bc58-8ebc7e35b2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:26.521126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538893a1-b9ef-4c9c-bc58-8ebc7e35b2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:26.522619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538893a1-b9ef-4c9c-bc58-8ebc7e35b2b9 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:26.532698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1082/2189] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:26.961077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e3f6c-199f-4f33-b79c-0d30d69acb32 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:26.962680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c61e3f6c-199f-4f33-b79c-0d30d69acb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:26.974731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e3f6c-199f-4f33-b79c-0d30d69acb32 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:26.979469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:26.980461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:26.980747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:26.981020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] PATH_INFO: `/v3/projects/6ac7266965604a2584f8332c693a8f99` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:26.982348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac7266965604a2584f8332c693a8f99)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:26.984357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:27.089972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:27.104928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac7266965604a2584f8332c693a8f99', 'request_id': 'req-e01d0dbe-893f-4345-88ac-a9bfccd585dd'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:27.111290 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac7266965604a2584f8332c693a8f99', 'request_id': 'req-e01d0dbe-893f-4345-88ac-a9bfccd585dd'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:27.187591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac7266965604a2584f8332c693a8f99', 'request_id': 'req-e01d0dbe-893f-4345-88ac-a9bfccd585dd'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:27.199229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] The token cache is being invalidate because project 6ac7266965604a2584f8332c693a8f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:48:27.203206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:27.203206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e01d0dbe-893f-4345-88ac-a9bfccd585dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:27.203206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1108/2190] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:48:26 2022] DELETE /identity/v3/projects/6ac7266965604a2584f8332c693a8f99 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:27.207531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d18f65-159a-47f6-8e88-4c6c6820a419 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:27.207828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d18f65-159a-47f6-8e88-4c6c6820a419 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:27.208113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d18f65-159a-47f6-8e88-4c6c6820a419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:27.226524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-74d18f65-159a-47f6-8e88-4c6c6820a419 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:27.227723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-74d18f65-159a-47f6-8e88-4c6c6820a419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:27.288032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1083/2191] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:27.296835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1e0b-2bef-4985-9b14-3a7353cfcd22 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:27.297140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1e0b-2bef-4985-9b14-3a7353cfcd22 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:27.297423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1e0b-2bef-4985-9b14-3a7353cfcd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:27.316185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-bffa1e0b-2bef-4985-9b14-3a7353cfcd22 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:27.317409 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bffa1e0b-2bef-4985-9b14-3a7353cfcd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:27.325367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1109/2192] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:27.329706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d18f65-159a-47f6-8e88-4c6c6820a419 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:27.339533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d18f65-159a-47f6-8e88-4c6c6820a419 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:27.344236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb052e35-9f6d-45ed-89d1-6c9ef6a0d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:27.344854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052e35-9f6d-45ed-89d1-6c9ef6a0d5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:27.345130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052e35-9f6d-45ed-89d1-6c9ef6a0d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:27.345400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052e35-9f6d-45ed-89d1-6c9ef6a0d5c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:27.346150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb052e35-9f6d-45ed-89d1-6c9ef6a0d5c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:48:27.346453 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb052e35-9f6d-45ed-89d1-6c9ef6a0d5c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:27.348038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb052e35-9f6d-45ed-89d1-6c9ef6a0d5c2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:27.360016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1084/2193] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:48:27.364103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1e0b-2bef-4985-9b14-3a7353cfcd22 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:27.375553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1e0b-2bef-4985-9b14-3a7353cfcd22 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:27.383629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687877b-798d-405c-b387-2e5983f48631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:27.384332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687877b-798d-405c-b387-2e5983f48631 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:27.386705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687877b-798d-405c-b387-2e5983f48631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:27.386999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687877b-798d-405c-b387-2e5983f48631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:27.387726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687877b-798d-405c-b387-2e5983f48631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:27.390152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687877b-798d-405c-b387-2e5983f48631 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:27.490695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1110/2194] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:48:27 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:48:27.494831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb052e35-9f6d-45ed-89d1-6c9ef6a0d5c2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:27.505687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb052e35-9f6d-45ed-89d1-6c9ef6a0d5c2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:27.551250 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:27.569862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0faa15-2151-4650-ad0b-ca0186138e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:27.570539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0faa15-2151-4650-ad0b-ca0186138e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:27.570835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0faa15-2151-4650-ad0b-ca0186138e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:27.571162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0faa15-2151-4650-ad0b-ca0186138e40 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:27.571810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0faa15-2151-4650-ad0b-ca0186138e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:27.573774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0faa15-2151-4650-ad0b-ca0186138e40 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:27.702351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1085/2195] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:48:27 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:27.706744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687877b-798d-405c-b387-2e5983f48631 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:27.717424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687877b-798d-405c-b387-2e5983f48631 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:27.721983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9897bd-9f6d-411a-8ae4-ffea9ad54919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:27.722632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9897bd-9f6d-411a-8ae4-ffea9ad54919 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:27.722911 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9897bd-9f6d-411a-8ae4-ffea9ad54919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:27.723182 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9897bd-9f6d-411a-8ae4-ffea9ad54919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:27.723898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9897bd-9f6d-411a-8ae4-ffea9ad54919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:27.725529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9897bd-9f6d-411a-8ae4-ffea9ad54919 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:27.738341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1111/2196] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:48:27.749108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0faa15-2151-4650-ad0b-ca0186138e40 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:27.759634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0faa15-2151-4650-ad0b-ca0186138e40 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:27.764625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cc59b-0d3c-4f3d-b1fd-c515e7063d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:27.765284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cc59b-0d3c-4f3d-b1fd-c515e7063d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:27.765572 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cc59b-0d3c-4f3d-b1fd-c515e7063d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:27.765854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cc59b-0d3c-4f3d-b1fd-c515e7063d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:27.766624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cc59b-0d3c-4f3d-b1fd-c515e7063d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:27.768237 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cc59b-0d3c-4f3d-b1fd-c515e7063d26 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:27.780664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1086/2197] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:27.784935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9897bd-9f6d-411a-8ae4-ffea9ad54919 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:27.795568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9897bd-9f6d-411a-8ae4-ffea9ad54919 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:27.800286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8d79a-11c0-4502-b5b5-ddfb9fd48e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:27.801179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8d79a-11c0-4502-b5b5-ddfb9fd48e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:27.801518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8d79a-11c0-4502-b5b5-ddfb9fd48e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:27.801796 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8d79a-11c0-4502-b5b5-ddfb9fd48e83 admin admin] PATH_INFO: `/v3/projects/6d67b90445024b5a953818eca2fbcdd9/users/a086a3fdbf504ae78c1894c77f724f25/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:27.816928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8d79a-11c0-4502-b5b5-ddfb9fd48e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d67b90445024b5a953818eca2fbcdd9, user_id=a086a3fdbf504ae78c1894c77f724f25, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:27.819580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8d79a-11c0-4502-b5b5-ddfb9fd48e83 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:27.902470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1112/2198] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:27 2022] PUT /identity/v3/projects/6d67b90445024b5a953818eca2fbcdd9/users/a086a3fdbf504ae78c1894c77f724f25/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:27.914343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a79791-ea4f-47cd-9fdc-ec84caa7cf11 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:27.914634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a79791-ea4f-47cd-9fdc-ec84caa7cf11 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:27.914919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a79791-ea4f-47cd-9fdc-ec84caa7cf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:27.943016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c5a79791-ea4f-47cd-9fdc-ec84caa7cf11 None None] MFA Rules not processed for user `a086a3fdbf504ae78c1894c77f724f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:27.944227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c5a79791-ea4f-47cd-9fdc-ec84caa7cf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:28.008066 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1087/2199] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:48:28.019814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8d79a-11c0-4502-b5b5-ddfb9fd48e83 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:28.021584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6ed8d79a-11c0-4502-b5b5-ddfb9fd48e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:28.082048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8d79a-11c0-4502-b5b5-ddfb9fd48e83 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:28.086014 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61472c-5590-4fea-94a8-9abb2107e78d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:28.086654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61472c-5590-4fea-94a8-9abb2107e78d service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:28.086934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61472c-5590-4fea-94a8-9abb2107e78d service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:28.087204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61472c-5590-4fea-94a8-9abb2107e78d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:28.096179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61472c-5590-4fea-94a8-9abb2107e78d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:28.097631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61472c-5590-4fea-94a8-9abb2107e78d service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:28.106529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1113/2200] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:35.858271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a79791-ea4f-47cd-9fdc-ec84caa7cf11 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:35.860247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c5a79791-ea4f-47cd-9fdc-ec84caa7cf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:35.957411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a79791-ea4f-47cd-9fdc-ec84caa7cf11 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:35.962891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398fc0a-4ee2-475b-8c39-24ef7eb59abd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:35.963595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398fc0a-4ee2-475b-8c39-24ef7eb59abd service placement] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:35.963835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398fc0a-4ee2-475b-8c39-24ef7eb59abd service placement] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:35.964124 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398fc0a-4ee2-475b-8c39-24ef7eb59abd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:35.965963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2398fc0a-4ee2-475b-8c39-24ef7eb59abd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:35.978010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398fc0a-4ee2-475b-8c39-24ef7eb59abd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:35.979606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398fc0a-4ee2-475b-8c39-24ef7eb59abd service placement] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:35.989970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1088/2201] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:37.426909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61472c-5590-4fea-94a8-9abb2107e78d service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:37.428328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6e61472c-5590-4fea-94a8-9abb2107e78d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:37.486536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:37.491767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61472c-5590-4fea-94a8-9abb2107e78d service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:37.496387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:37.499210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:37.499210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:37.499210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] PATH_INFO: `/v3/users/b7244d0897184b45b34e03a3a6772cf8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:37.499624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7244d0897184b45b34e03a3a6772cf8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:37.501646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:37.713880 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7244d0897184b45b34e03a3a6772cf8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:37.791389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7244d0897184b45b34e03a3a6772cf8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:37.792009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7244d0897184b45b34e03a3a6772cf8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:37.792612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7244d0897184b45b34e03a3a6772cf8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:37.799988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7244d0897184b45b34e03a3a6772cf8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:37.817672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1114/2202] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:48:37 2022] DELETE /identity/v3/users/b7244d0897184b45b34e03a3a6772cf8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:37.822106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6c4b-ab48-4142-b637-5a7dd22dadd9 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:37.824196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6c4b-ab48-4142-b637-5a7dd22dadd9 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:37.824196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6c4b-ab48-4142-b637-5a7dd22dadd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:37.841118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8cdc6c4b-ab48-4142-b637-5a7dd22dadd9 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:37.842940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8cdc6c4b-ab48-4142-b637-5a7dd22dadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:37.854521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:37.902836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1089/2203] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:37.913866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:37.915385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:37.976555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f28e6-0a39-4443-a60d-de027e3ebde4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:37.980191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02def5b3-0812-4ab4-b49e-7f62aca1dd14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:37.980872 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02def5b3-0812-4ab4-b49e-7f62aca1dd14 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:37.981155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02def5b3-0812-4ab4-b49e-7f62aca1dd14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:37.981431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02def5b3-0812-4ab4-b49e-7f62aca1dd14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:37.994604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02def5b3-0812-4ab4-b49e-7f62aca1dd14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:37.994604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02def5b3-0812-4ab4-b49e-7f62aca1dd14 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:38.003274 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1115/2204] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:38.461969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc6c4b-ab48-4142-b637-5a7dd22dadd9 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:38.463601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8cdc6c4b-ab48-4142-b637-5a7dd22dadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:38.476729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc6c4b-ab48-4142-b637-5a7dd22dadd9 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:38.481071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:38.481934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:38.482777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:38.483068 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] PATH_INFO: `/v3/projects/b9107cc53c8648999bea2e938bcb8e2b` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:38.484337 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9107cc53c8648999bea2e938bcb8e2b)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:38.486268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:38.603706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9107cc53c8648999bea2e938bcb8e2b', 'request_id': 'req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:38.676988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9107cc53c8648999bea2e938bcb8e2b', 'request_id': 'req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:38.683772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9107cc53c8648999bea2e938bcb8e2b', 'request_id': 'req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:38.695404 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] The token cache is being invalidate because project b9107cc53c8648999bea2e938bcb8e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:48:38.695693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:38.696339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:38.697892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1090/2205] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:48:38 2022] DELETE /identity/v3/projects/b9107cc53c8648999bea2e938bcb8e2b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:38.702264 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02def5b3-0812-4ab4-b49e-7f62aca1dd14 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:38.712383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02def5b3-0812-4ab4-b49e-7f62aca1dd14 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:38.769236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:38.770116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:38.770447 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:38.770727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] PATH_INFO: `/v3/users/a04fa6a9f74d4c8794eecadc83495c75` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:38.771919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04fa6a9f74d4c8794eecadc83495c75)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:38.773897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:38.796267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:38.970472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04fa6a9f74d4c8794eecadc83495c75'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.041997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:39.043434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:39.057033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bbb83-64c1-405a-b3c6-c5ade1a7f7d8 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:39.062001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:39.062872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:39.063155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:39.063428 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] PATH_INFO: `/v3/users/a086a3fdbf504ae78c1894c77f724f25` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:39.064822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a086a3fdbf504ae78c1894c77f724f25)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:39.065631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04fa6a9f74d4c8794eecadc83495c75'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.066287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04fa6a9f74d4c8794eecadc83495c75'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.066763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:39.066903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04fa6a9f74d4c8794eecadc83495c75'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.074896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-38b9122e-81d3-464c-9395-af0f894caf92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04fa6a9f74d4c8794eecadc83495c75'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.094753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1116/2206] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:48:38 2022] DELETE /identity/v3/users/a04fa6a9f74d4c8794eecadc83495c75 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:39.235851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a086a3fdbf504ae78c1894c77f724f25'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.236454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a086a3fdbf504ae78c1894c77f724f25'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.243373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a086a3fdbf504ae78c1894c77f724f25'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.255504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a086a3fdbf504ae78c1894c77f724f25'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.325427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a086a3fdbf504ae78c1894c77f724f25'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.333735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1091/2207] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:48:39 2022] DELETE /identity/v3/users/a086a3fdbf504ae78c1894c77f724f25 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:39.338329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b7907-343e-4a76-b978-7101e98fb9c0 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:39.338626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b7907-343e-4a76-b978-7101e98fb9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:39.338909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b7907-343e-4a76-b978-7101e98fb9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:39.358067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-397b7907-343e-4a76-b978-7101e98fb9c0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:39.359307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-397b7907-343e-4a76-b978-7101e98fb9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:39.419444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1117/2208] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:48:39.429737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:39.431145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:39.446292 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:39.489732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f20e0-aeee-4d49-b991-40eb9441bb49 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:39.493330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded280fe-a0ee-4c81-909a-07a674916274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:39.493974 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded280fe-a0ee-4c81-909a-07a674916274 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:39.494258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded280fe-a0ee-4c81-909a-07a674916274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:39.497327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded280fe-a0ee-4c81-909a-07a674916274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:39.498277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b7907-343e-4a76-b978-7101e98fb9c0 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:39.499756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-397b7907-343e-4a76-b978-7101e98fb9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:39.507802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded280fe-a0ee-4c81-909a-07a674916274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:39.509435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded280fe-a0ee-4c81-909a-07a674916274 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:39.512512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b7907-343e-4a76-b978-7101e98fb9c0 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:39.517591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:39.518505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:39.518795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:39.519330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] PATH_INFO: `/v3/projects/fb066458aed146289201579a63c8b07e` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:39.519936 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1092/2209] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:39.520591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb066458aed146289201579a63c8b07e)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:39.522674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:39.631682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb066458aed146289201579a63c8b07e', 'request_id': 'req-8e5b50b0-8c68-4590-9313-96cb69ae6b29'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.637071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb066458aed146289201579a63c8b07e', 'request_id': 'req-8e5b50b0-8c68-4590-9313-96cb69ae6b29'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.731011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb066458aed146289201579a63c8b07e', 'request_id': 'req-8e5b50b0-8c68-4590-9313-96cb69ae6b29'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.743843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] The token cache is being invalidate because project fb066458aed146289201579a63c8b07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:48:39.744061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.744742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8e5b50b0-8c68-4590-9313-96cb69ae6b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:39.746309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1118/2210] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:48:39 2022] DELETE /identity/v3/projects/fb066458aed146289201579a63c8b07e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:48:39.751658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2752d-d26a-45db-a844-e6a2b900d883 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:39.752011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2752d-d26a-45db-a844-e6a2b900d883 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:39.752434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2752d-d26a-45db-a844-e6a2b900d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:39.770866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-cba2752d-d26a-45db-a844-e6a2b900d883 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:39.772064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-cba2752d-d26a-45db-a844-e6a2b900d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:39.842900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1093/2211] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:39.851090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c563a7-62bf-4410-81b0-916b89cb1699 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:39.851384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c563a7-62bf-4410-81b0-916b89cb1699 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:39.851669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c563a7-62bf-4410-81b0-916b89cb1699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:39.870550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-96c563a7-62bf-4410-81b0-916b89cb1699 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:39.871778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-96c563a7-62bf-4410-81b0-916b89cb1699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:39.880003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1119/2212] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:39.884184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2752d-d26a-45db-a844-e6a2b900d883 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:39.894536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2752d-d26a-45db-a844-e6a2b900d883 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:39.899228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:39.901150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:39.901150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:39.901150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:39.901457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:48:39.901681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:39.903296 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:39.915483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1094/2213] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:48:39.919827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c563a7-62bf-4410-81b0-916b89cb1699 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:39.929323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c563a7-62bf-4410-81b0-916b89cb1699 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:39.934030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915ecf6-1cb9-425a-b8c7-b5b753433bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:39.934679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915ecf6-1cb9-425a-b8c7-b5b753433bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:39.934985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915ecf6-1cb9-425a-b8c7-b5b753433bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:39.935245 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915ecf6-1cb9-425a-b8c7-b5b753433bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:39.936121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915ecf6-1cb9-425a-b8c7-b5b753433bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:39.938120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915ecf6-1cb9-425a-b8c7-b5b753433bcc admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:39.948078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:39.992964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:39.994810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:40.009556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03475e7-de19-4a19-842e-1477e10ab6a9 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.018093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.018093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.018093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.018093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] PATH_INFO: `/v3/projects/6d67b90445024b5a953818eca2fbcdd9` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.018918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d67b90445024b5a953818eca2fbcdd9)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.021004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.023327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1120/2214] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:48:39 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:40.027327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915ecf6-1cb9-425a-b8c7-b5b753433bcc admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.090044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915ecf6-1cb9-425a-b8c7-b5b753433bcc admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.096320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b502d4-8c98-48a7-85c2-09bdf97ebadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.096996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b502d4-8c98-48a7-85c2-09bdf97ebadd admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.097281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b502d4-8c98-48a7-85c2-09bdf97ebadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.097561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b502d4-8c98-48a7-85c2-09bdf97ebadd admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.098269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b502d4-8c98-48a7-85c2-09bdf97ebadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.100206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b502d4-8c98-48a7-85c2-09bdf97ebadd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.140742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d67b90445024b5a953818eca2fbcdd9', 'request_id': 'req-212f6935-27c5-4e04-a0cf-aa80ac32f49c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:40.210074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1121/2215] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:48:40 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:40.214391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b502d4-8c98-48a7-85c2-09bdf97ebadd admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.225153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b502d4-8c98-48a7-85c2-09bdf97ebadd admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.225447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d67b90445024b5a953818eca2fbcdd9', 'request_id': 'req-212f6935-27c5-4e04-a0cf-aa80ac32f49c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:40.233196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d67b90445024b5a953818eca2fbcdd9', 'request_id': 'req-212f6935-27c5-4e04-a0cf-aa80ac32f49c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:40.245428 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] The token cache is being invalidate because project 6d67b90445024b5a953818eca2fbcdd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:48:40.245975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:40.246759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-212f6935-27c5-4e04-a0cf-aa80ac32f49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:40.249458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1095/2216] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:48:39 2022] DELETE /identity/v3/projects/6d67b90445024b5a953818eca2fbcdd9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:48:40.254715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5218d8e-d17c-4c9c-b03c-9309c31d0b4a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.255034 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5218d8e-d17c-4c9c-b03c-9309c31d0b4a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.255312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5218d8e-d17c-4c9c-b03c-9309c31d0b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.274710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-e5218d8e-d17c-4c9c-b03c-9309c31d0b4a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:40.275963 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e5218d8e-d17c-4c9c-b03c-9309c31d0b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:40.288619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332d750-3c7d-485e-a491-807249129074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.289291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d750-3c7d-485e-a491-807249129074 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.289570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d750-3c7d-485e-a491-807249129074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.289847 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d750-3c7d-485e-a491-807249129074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.290571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332d750-3c7d-485e-a491-807249129074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.292163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332d750-3c7d-485e-a491-807249129074 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.298599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:40.302076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1122/2217] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:48:40.306054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332d750-3c7d-485e-a491-807249129074 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.307783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6332d750-3c7d-485e-a491-807249129074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:40.320265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332d750-3c7d-485e-a491-807249129074 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.325242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef19836-b9d8-4ae5-b402-7365a26ace35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.325904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef19836-b9d8-4ae5-b402-7365a26ace35 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.326885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef19836-b9d8-4ae5-b402-7365a26ace35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.327533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef19836-b9d8-4ae5-b402-7365a26ace35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.328261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef19836-b9d8-4ae5-b402-7365a26ace35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.329936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef19836-b9d8-4ae5-b402-7365a26ace35 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.338995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1096/2218] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:48:40.340662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1123/2219] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:48:40.344933 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5218d8e-d17c-4c9c-b03c-9309c31d0b4a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.347366 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2b549-36b9-4f3b-9a7d-e943da277e8c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.347661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2b549-36b9-4f3b-9a7d-e943da277e8c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.347942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2b549-36b9-4f3b-9a7d-e943da277e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.354503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5218d8e-d17c-4c9c-b03c-9309c31d0b4a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.359123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5966554-22b8-49e3-9450-8648245b6fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.359994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966554-22b8-49e3-9450-8648245b6fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.360275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966554-22b8-49e3-9450-8648245b6fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.360647 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966554-22b8-49e3-9450-8648245b6fa9 admin admin] PATH_INFO: `/v3/projects/c797efcafacc4c26948e9464f865d951/users/5a1fe77520444c05a5f1da12d0983e4a/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.366076 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-edd2b549-36b9-4f3b-9a7d-e943da277e8c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:40.367354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-edd2b549-36b9-4f3b-9a7d-e943da277e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:40.375441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5966554-22b8-49e3-9450-8648245b6fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c797efcafacc4c26948e9464f865d951, user_id=5a1fe77520444c05a5f1da12d0983e4a, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.376594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1124/2220] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:48:40.378183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5966554-22b8-49e3-9450-8648245b6fa9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.380715 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2b549-36b9-4f3b-9a7d-e943da277e8c None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.390222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2b549-36b9-4f3b-9a7d-e943da277e8c None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.395038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6b6da-151f-42b6-8ba2-1d9e966f855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.395677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b6da-151f-42b6-8ba2-1d9e966f855d admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.395958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b6da-151f-42b6-8ba2-1d9e966f855d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.396234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b6da-151f-42b6-8ba2-1d9e966f855d admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.396987 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6b6da-151f-42b6-8ba2-1d9e966f855d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:48:40.397291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6b6da-151f-42b6-8ba2-1d9e966f855d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.398909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6b6da-151f-42b6-8ba2-1d9e966f855d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.410421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1125/2221] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:48:40.414438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6b6da-151f-42b6-8ba2-1d9e966f855d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.423704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6b6da-151f-42b6-8ba2-1d9e966f855d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.428269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a67c64-86cb-45e2-8ead-a3fa45f457a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.428904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a67c64-86cb-45e2-8ead-a3fa45f457a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.429185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a67c64-86cb-45e2-8ead-a3fa45f457a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.429460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a67c64-86cb-45e2-8ead-a3fa45f457a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.430127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a67c64-86cb-45e2-8ead-a3fa45f457a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.431981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a67c64-86cb-45e2-8ead-a3fa45f457a4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.448781 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1097/2222] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:40 2022] PUT /identity/v3/projects/c797efcafacc4c26948e9464f865d951/users/5a1fe77520444c05a5f1da12d0983e4a/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:48:40.460267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea5079-4c09-4d3c-86e3-89167cbc6006 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.460602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea5079-4c09-4d3c-86e3-89167cbc6006 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.460896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea5079-4c09-4d3c-86e3-89167cbc6006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.487295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-97ea5079-4c09-4d3c-86e3-89167cbc6006 None None] MFA Rules not processed for user `5a1fe77520444c05a5f1da12d0983e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:40.488571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-97ea5079-4c09-4d3c-86e3-89167cbc6006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:40.533489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1126/2223] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:48:40 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:48:40.534797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a67c64-86cb-45e2-8ead-a3fa45f457a4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.554315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1098/2224] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:48:40.566355 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea5079-4c09-4d3c-86e3-89167cbc6006 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.567905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-97ea5079-4c09-4d3c-86e3-89167cbc6006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:40.568918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:40.605698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a67c64-86cb-45e2-8ead-a3fa45f457a4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.612841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13508ee8-3550-4bf6-bc0e-f6ca3fa7fb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.616636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13508ee8-3550-4bf6-bc0e-f6ca3fa7fb1f admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.616636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13508ee8-3550-4bf6-bc0e-f6ca3fa7fb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.616636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13508ee8-3550-4bf6-bc0e-f6ca3fa7fb1f admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.616636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13508ee8-3550-4bf6-bc0e-f6ca3fa7fb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.616955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13508ee8-3550-4bf6-bc0e-f6ca3fa7fb1f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.625004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea5079-4c09-4d3c-86e3-89167cbc6006 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.668833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:40.674056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71394d-4f02-4225-9bfa-e0c835241e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.674722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71394d-4f02-4225-9bfa-e0c835241e61 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.675008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71394d-4f02-4225-9bfa-e0c835241e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.675286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71394d-4f02-4225-9bfa-e0c835241e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.729297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1127/2225] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:48:40 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:48:40.731433 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71394d-4f02-4225-9bfa-e0c835241e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.733684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71394d-4f02-4225-9bfa-e0c835241e61 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.733858 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13508ee8-3550-4bf6-bc0e-f6ca3fa7fb1f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.743323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1099/2226] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:48:40.743536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13508ee8-3550-4bf6-bc0e-f6ca3fa7fb1f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.748527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73586e35-92d2-486b-9db9-5ca871630c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.749336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73586e35-92d2-486b-9db9-5ca871630c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.749612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73586e35-92d2-486b-9db9-5ca871630c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.749889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73586e35-92d2-486b-9db9-5ca871630c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.750617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73586e35-92d2-486b-9db9-5ca871630c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.752252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73586e35-92d2-486b-9db9-5ca871630c21 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.762794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1128/2227] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:48:40.764332 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71394d-4f02-4225-9bfa-e0c835241e61 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.766984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73586e35-92d2-486b-9db9-5ca871630c21 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.776698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73586e35-92d2-486b-9db9-5ca871630c21 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.777024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71394d-4f02-4225-9bfa-e0c835241e61 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.782157 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb061-13ab-4494-95fd-9c4375032f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.782789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.782916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb061-13ab-4494-95fd-9c4375032f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.783185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb061-13ab-4494-95fd-9c4375032f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.783469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb061-13ab-4494-95fd-9c4375032f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.783710 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.784084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.784181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb061-13ab-4494-95fd-9c4375032f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.784413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] PATH_INFO: `/v3/users/5a1fe77520444c05a5f1da12d0983e4a` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.785657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1fe77520444c05a5f1da12d0983e4a)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.793144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb061-13ab-4494-95fd-9c4375032f25 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.793345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.796388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1129/2228] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:48:40.800203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb061-13ab-4494-95fd-9c4375032f25 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:40.809732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb061-13ab-4494-95fd-9c4375032f25 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:40.814497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d581-6d19-44e8-a767-d331f5fa7f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:40.815356 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d581-6d19-44e8-a767-d331f5fa7f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.815642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d581-6d19-44e8-a767-d331f5fa7f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.815921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d581-6d19-44e8-a767-d331f5fa7f0b admin admin] PATH_INFO: `/v3/projects/74aa5dda63754f62b71d74fcaa4bee01/users/3d8a088405d549cda80615fd41a661c0/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.831118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61d581-6d19-44e8-a767-d331f5fa7f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74aa5dda63754f62b71d74fcaa4bee01, user_id=3d8a088405d549cda80615fd41a661c0, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:40.834084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61d581-6d19-44e8-a767-d331f5fa7f0b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:40.917312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1130/2229] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:40 2022] PUT /identity/v3/projects/74aa5dda63754f62b71d74fcaa4bee01/users/3d8a088405d549cda80615fd41a661c0/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:48:40.922736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828de50-8208-4d1f-b6d2-75a403ba28fb None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:40.923032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828de50-8208-4d1f-b6d2-75a403ba28fb None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:40.923334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828de50-8208-4d1f-b6d2-75a403ba28fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:40.940267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b828de50-8208-4d1f-b6d2-75a403ba28fb None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:40.941516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b828de50-8208-4d1f-b6d2-75a403ba28fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:41.000540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1fe77520444c05a5f1da12d0983e4a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.001207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1fe77520444c05a5f1da12d0983e4a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.001711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1131/2230] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:48:41.008494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1fe77520444c05a5f1da12d0983e4a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.010923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828de50-8208-4d1f-b6d2-75a403ba28fb None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:41.012360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b828de50-8208-4d1f-b6d2-75a403ba28fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:41.021830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1fe77520444c05a5f1da12d0983e4a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.069993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828de50-8208-4d1f-b6d2-75a403ba28fb None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:41.073639 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fcff3-dabe-4719-baf5-d2a38db94d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:41.074284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fcff3-dabe-4719-baf5-d2a38db94d6f service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:41.074571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fcff3-dabe-4719-baf5-d2a38db94d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:41.074850 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fcff3-dabe-4719-baf5-d2a38db94d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:41.083450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-da996d65-b3be-496f-a952-f629735e05be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1fe77520444c05a5f1da12d0983e4a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.084862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fcff3-dabe-4719-baf5-d2a38db94d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:41.086320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fcff3-dabe-4719-baf5-d2a38db94d6f service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:41.089981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1100/2231] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:48:40 2022] DELETE /identity/v3/users/5a1fe77520444c05a5f1da12d0983e4a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:48:41.095588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411424e-b62b-434f-97bc-1329a1ce6663 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:41.099861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411424e-b62b-434f-97bc-1329a1ce6663 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:41.099861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411424e-b62b-434f-97bc-1329a1ce6663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:41.100045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1132/2232] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:48:41.114808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2411424e-b62b-434f-97bc-1329a1ce6663 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:41.116009 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2411424e-b62b-434f-97bc-1329a1ce6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:41.174787 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1101/2233] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:41.184555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fcff3-dabe-4719-baf5-d2a38db94d6f service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:41.186105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-352fcff3-dabe-4719-baf5-d2a38db94d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:41.198187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fcff3-dabe-4719-baf5-d2a38db94d6f service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:41.206696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:41.260432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaf4c8-8181-4dbb-b3e5-7f0dfddda0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:41.261159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf4c8-8181-4dbb-b3e5-7f0dfddda0bc service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:41.261445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf4c8-8181-4dbb-b3e5-7f0dfddda0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:41.261723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf4c8-8181-4dbb-b3e5-7f0dfddda0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:41.271759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaf4c8-8181-4dbb-b3e5-7f0dfddda0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:41.273264 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaf4c8-8181-4dbb-b3e5-7f0dfddda0bc service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:41.284478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1133/2234] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:41.733178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411424e-b62b-434f-97bc-1329a1ce6663 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:41.735511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2411424e-b62b-434f-97bc-1329a1ce6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:41.747253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411424e-b62b-434f-97bc-1329a1ce6663 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:41.753131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:41.754062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:41.755018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:41.755018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] PATH_INFO: `/v3/projects/c797efcafacc4c26948e9464f865d951` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:41.756033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c797efcafacc4c26948e9464f865d951)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:41.758073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:41.771769 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:41.854805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c797efcafacc4c26948e9464f865d951', 'request_id': 'req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.922780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c797efcafacc4c26948e9464f865d951', 'request_id': 'req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.929539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c797efcafacc4c26948e9464f865d951', 'request_id': 'req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.940339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] The token cache is being invalidate because project c797efcafacc4c26948e9464f865d951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:48:41.940632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.941256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9ecc0bb3-7ed4-4fc4-a489-c6dc0d950c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:48:41.942805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1102/2235] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:48:41 2022] DELETE /identity/v3/projects/c797efcafacc4c26948e9464f865d951 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:41.948270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e45cd-8101-4ec2-8f1b-4950db65f1b5 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:41.948794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e45cd-8101-4ec2-8f1b-4950db65f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:41.948900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e45cd-8101-4ec2-8f1b-4950db65f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:41.968136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6c1e45cd-8101-4ec2-8f1b-4950db65f1b5 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:41.969388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6c1e45cd-8101-4ec2-8f1b-4950db65f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:42.031150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1134/2236] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:42.039724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb01bca-7a2d-4c38-8afe-186d855ecea7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:42.040100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb01bca-7a2d-4c38-8afe-186d855ecea7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:42.043644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb01bca-7a2d-4c38-8afe-186d855ecea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:42.061284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-ecb01bca-7a2d-4c38-8afe-186d855ecea7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:42.062599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ecb01bca-7a2d-4c38-8afe-186d855ecea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:42.070959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1103/2237] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:42.075318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e45cd-8101-4ec2-8f1b-4950db65f1b5 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:42.085940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e45cd-8101-4ec2-8f1b-4950db65f1b5 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:42.090626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8569c89-91ab-4713-884b-bfb0073d8c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:42.095158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8569c89-91ab-4713-884b-bfb0073d8c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:42.095158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8569c89-91ab-4713-884b-bfb0073d8c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:42.095158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8569c89-91ab-4713-884b-bfb0073d8c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:42.095158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8569c89-91ab-4713-884b-bfb0073d8c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:48:42.095158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8569c89-91ab-4713-884b-bfb0073d8c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:42.095158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8569c89-91ab-4713-884b-bfb0073d8c77 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:42.106368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1135/2238] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:48:42.111474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb01bca-7a2d-4c38-8afe-186d855ecea7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:42.120824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb01bca-7a2d-4c38-8afe-186d855ecea7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:42.126985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a6612-636b-467c-8c51-68f8c728a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:42.127499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a6612-636b-467c-8c51-68f8c728a0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:42.127786 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a6612-636b-467c-8c51-68f8c728a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:42.128070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a6612-636b-467c-8c51-68f8c728a0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:42.128846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a6612-636b-467c-8c51-68f8c728a0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:42.130759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a6612-636b-467c-8c51-68f8c728a0a8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:42.233671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1104/2239] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:48:42 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:42.237855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8569c89-91ab-4713-884b-bfb0073d8c77 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:42.248676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8569c89-91ab-4713-884b-bfb0073d8c77 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:42.309110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448f0c-6851-45b6-922d-b9043c772cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:42.309886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448f0c-6851-45b6-922d-b9043c772cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:42.310228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448f0c-6851-45b6-922d-b9043c772cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:42.311085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448f0c-6851-45b6-922d-b9043c772cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:42.311959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7448f0c-6851-45b6-922d-b9043c772cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:42.314003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7448f0c-6851-45b6-922d-b9043c772cf4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:42.429263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1136/2240] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:48:42 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:42.433298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a6612-636b-467c-8c51-68f8c728a0a8 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:42.444637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a6612-636b-467c-8c51-68f8c728a0a8 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:42.449274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaef3a3-6966-4118-a67a-6023ad1a1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:42.450025 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaef3a3-6966-4118-a67a-6023ad1a1c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:42.450314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaef3a3-6966-4118-a67a-6023ad1a1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:42.450593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaef3a3-6966-4118-a67a-6023ad1a1c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:42.451325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaef3a3-6966-4118-a67a-6023ad1a1c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:42.452993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaef3a3-6966-4118-a67a-6023ad1a1c7b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:42.463432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1105/2241] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:42.468025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448f0c-6851-45b6-922d-b9043c772cf4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:42.479320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448f0c-6851-45b6-922d-b9043c772cf4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:42.486049 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492b0e-6916-4bce-9ecc-18044aa0ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:42.486742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492b0e-6916-4bce-9ecc-18044aa0ea43 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:42.487031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492b0e-6916-4bce-9ecc-18044aa0ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:42.487312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492b0e-6916-4bce-9ecc-18044aa0ea43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:42.488144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492b0e-6916-4bce-9ecc-18044aa0ea43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:42.489812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492b0e-6916-4bce-9ecc-18044aa0ea43 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:42.501667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1137/2242] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:42.506084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaef3a3-6966-4118-a67a-6023ad1a1c7b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:42.519546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaef3a3-6966-4118-a67a-6023ad1a1c7b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:42.523267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e8eaf-dad5-47bf-821b-0016a3aa1a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:42.524165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e8eaf-dad5-47bf-821b-0016a3aa1a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:42.524494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e8eaf-dad5-47bf-821b-0016a3aa1a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:42.524776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e8eaf-dad5-47bf-821b-0016a3aa1a68 admin admin] PATH_INFO: `/v3/projects/76b9d240f85540c5bb0645d0612dd064/users/f7662fbecc844dcabbbd224577864644/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:42.541494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e8eaf-dad5-47bf-821b-0016a3aa1a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b9d240f85540c5bb0645d0612dd064, user_id=f7662fbecc844dcabbbd224577864644, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:42.544183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e8eaf-dad5-47bf-821b-0016a3aa1a68 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:42.624308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1106/2243] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:42 2022] PUT /identity/v3/projects/76b9d240f85540c5bb0645d0612dd064/users/f7662fbecc844dcabbbd224577864644/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:42.634122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff431-3d88-44b1-aa9c-9397f293abda None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:42.634542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff431-3d88-44b1-aa9c-9397f293abda None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:42.634925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff431-3d88-44b1-aa9c-9397f293abda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:42.665100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-eeaff431-3d88-44b1-aa9c-9397f293abda None None] MFA Rules not processed for user `f7662fbecc844dcabbbd224577864644`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:42.666490 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-eeaff431-3d88-44b1-aa9c-9397f293abda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:42.676468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:42.735100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1138/2244] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:42.746075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e8eaf-dad5-47bf-821b-0016a3aa1a68 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:42.748023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c62e8eaf-dad5-47bf-821b-0016a3aa1a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:42.840619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e8eaf-dad5-47bf-821b-0016a3aa1a68 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:42.845208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76001b39-47a7-4d3b-b5f6-c112cb307a3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9533e8371e64161a4c54eeab867a17e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:42.845872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001b39-47a7-4d3b-b5f6-c112cb307a3e service glance] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:42.846772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001b39-47a7-4d3b-b5f6-c112cb307a3e service glance] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:42.846772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001b39-47a7-4d3b-b5f6-c112cb307a3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:42.855867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76001b39-47a7-4d3b-b5f6-c112cb307a3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:42.861011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76001b39-47a7-4d3b-b5f6-c112cb307a3e service glance] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:42.867884 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1107/2245] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:46.630362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f6b3-9f27-4732-b9e5-63a4c0c63535 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:46.630899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f6b3-9f27-4732-b9e5-63a4c0c63535 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:46.630899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f6b3-9f27-4732-b9e5-63a4c0c63535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:46.661807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-28d1f6b3-9f27-4732-b9e5-63a4c0c63535 None None] MFA Rules not processed for user `3d8a088405d549cda80615fd41a661c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:46.663040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-28d1f6b3-9f27-4732-b9e5-63a4c0c63535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:46.736270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1139/2246] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:46.741073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76001b39-47a7-4d3b-b5f6-c112cb307a3e service glance] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:46.742528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-76001b39-47a7-4d3b-b5f6-c112cb307a3e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:46.767437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:46.815947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76001b39-47a7-4d3b-b5f6-c112cb307a3e service glance] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:46.820746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0511a1-cbed-4697-9ae8-4a5adb147f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:46.821460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0511a1-cbed-4697-9ae8-4a5adb147f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:46.821746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0511a1-cbed-4697-9ae8-4a5adb147f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:46.822020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0511a1-cbed-4697-9ae8-4a5adb147f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:46.822727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0511a1-cbed-4697-9ae8-4a5adb147f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:46.824704 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0511a1-cbed-4697-9ae8-4a5adb147f6e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:46.946036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1108/2247] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:48:46 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:46.950624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1f6b3-9f27-4732-b9e5-63a4c0c63535 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:46.969497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1f6b3-9f27-4732-b9e5-63a4c0c63535 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:47.034980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2769-03cf-4ea1-88ad-d1c25071bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:47.035652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2769-03cf-4ea1-88ad-d1c25071bf00 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:47.035935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2769-03cf-4ea1-88ad-d1c25071bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:47.036214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2769-03cf-4ea1-88ad-d1c25071bf00 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:47.036928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e2769-03cf-4ea1-88ad-d1c25071bf00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:47.038859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e2769-03cf-4ea1-88ad-d1c25071bf00 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:47.126968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1140/2248] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:48:46 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:48:47.130792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0511a1-cbed-4697-9ae8-4a5adb147f6e admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:47.143219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0511a1-cbed-4697-9ae8-4a5adb147f6e admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:47.147940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ebf3-ada4-4e70-ad0c-6587ddcfc9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:47.148625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ebf3-ada4-4e70-ad0c-6587ddcfc9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:47.148904 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ebf3-ada4-4e70-ad0c-6587ddcfc9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:47.149175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ebf3-ada4-4e70-ad0c-6587ddcfc9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:47.149927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ebf3-ada4-4e70-ad0c-6587ddcfc9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:47.151518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ebf3-ada4-4e70-ad0c-6587ddcfc9b5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:47.161742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1109/2249] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:48:47.172852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2769-03cf-4ea1-88ad-d1c25071bf00 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:47.179914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2769-03cf-4ea1-88ad-d1c25071bf00 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:47.184773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04166-5acc-4c33-9e3c-cac88ab27263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:47.186256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04166-5acc-4c33-9e3c-cac88ab27263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:47.186605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04166-5acc-4c33-9e3c-cac88ab27263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:47.186878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04166-5acc-4c33-9e3c-cac88ab27263 admin admin] PATH_INFO: `/v3/projects/cc71d5461ddf415d930a918d49285599/users/d68bf02177f24e2498ee003198dbdec1/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:47.203674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace04166-5acc-4c33-9e3c-cac88ab27263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc71d5461ddf415d930a918d49285599, user_id=d68bf02177f24e2498ee003198dbdec1, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:47.206668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace04166-5acc-4c33-9e3c-cac88ab27263 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:47.275506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1141/2250] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:47 2022] PUT /identity/v3/projects/cc71d5461ddf415d930a918d49285599/users/d68bf02177f24e2498ee003198dbdec1/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:47.279709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ebf3-ada4-4e70-ad0c-6587ddcfc9b5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:47.290369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ebf3-ada4-4e70-ad0c-6587ddcfc9b5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:47.347643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4223405-6956-4ec3-8c69-660422c1705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:47.348466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4223405-6956-4ec3-8c69-660422c1705e admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:47.348876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4223405-6956-4ec3-8c69-660422c1705e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:47.349152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4223405-6956-4ec3-8c69-660422c1705e admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:47.350039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4223405-6956-4ec3-8c69-660422c1705e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:47.351938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4223405-6956-4ec3-8c69-660422c1705e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:47.363731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1110/2251] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:48:47.367202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04166-5acc-4c33-9e3c-cac88ab27263 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:47.374779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:47.379957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04166-5acc-4c33-9e3c-cac88ab27263 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:47.385253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2765-6623-42ec-8305-cdf58c670e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:47.391744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2765-6623-42ec-8305-cdf58c670e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:47.391744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2765-6623-42ec-8305-cdf58c670e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:47.391744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2765-6623-42ec-8305-cdf58c670e76 admin admin] PATH_INFO: `/v3/projects/cc71d5461ddf415d930a918d49285599/users/d68bf02177f24e2498ee003198dbdec1/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:47.391744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2765-6623-42ec-8305-cdf58c670e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc71d5461ddf415d930a918d49285599, user_id=d68bf02177f24e2498ee003198dbdec1, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:47.391744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2765-6623-42ec-8305-cdf58c670e76 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:47.402642 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1142/2252] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:48:47 2022] PUT /identity/v3/projects/cc71d5461ddf415d930a918d49285599/users/d68bf02177f24e2498ee003198dbdec1/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:48:53.343041 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034a0a-e58d-42fc-9cb3-20f68655d6c0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:53.343575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034a0a-e58d-42fc-9cb3-20f68655d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:53.343658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034a0a-e58d-42fc-9cb3-20f68655d6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:53.391230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-68034a0a-e58d-42fc-9cb3-20f68655d6c0 None None] MFA Rules not processed for user `d68bf02177f24e2498ee003198dbdec1`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:53.399154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-68034a0a-e58d-42fc-9cb3-20f68655d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:53.495102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1111/2253] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:48:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:48:53.510303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2765-6623-42ec-8305-cdf58c670e76 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:53.512134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0c6d2765-6623-42ec-8305-cdf58c670e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:53.585398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2765-6623-42ec-8305-cdf58c670e76 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:53.589109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f57d-d6dc-4f36-a1d3-73a77b1d2dc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9533e8371e64161a4c54eeab867a17e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:53.589756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f57d-d6dc-4f36-a1d3-73a77b1d2dc3 service glance] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:53.590053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f57d-d6dc-4f36-a1d3-73a77b1d2dc3 service glance] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:53.590333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f57d-d6dc-4f36-a1d3-73a77b1d2dc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:53.660700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8f57d-d6dc-4f36-a1d3-73a77b1d2dc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:53.662382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8f57d-d6dc-4f36-a1d3-73a77b1d2dc3 service glance] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:53.675001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1143/2254] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:48:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:48:54.009329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac1972-c016-4c3a-ac98-58614d6505ea None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:54.009622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac1972-c016-4c3a-ac98-58614d6505ea None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:54.009952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac1972-c016-4c3a-ac98-58614d6505ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:54.026709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:54.071583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-feac1972-c016-4c3a-ac98-58614d6505ea None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:48:54.072909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-feac1972-c016-4c3a-ac98-58614d6505ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:54.162773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1112/2255] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:48:54.219644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f57d-d6dc-4f36-a1d3-73a77b1d2dc3 service glance] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:48:54.221037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-51d8f57d-d6dc-4f36-a1d3-73a77b1d2dc3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:48:54.329546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f57d-d6dc-4f36-a1d3-73a77b1d2dc3 service glance] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:48:54.335355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98248bb-e802-4f34-a0d8-dd3c66fc0285 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:48:54.336063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98248bb-e802-4f34-a0d8-dd3c66fc0285 service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:48:54.336381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98248bb-e802-4f34-a0d8-dd3c66fc0285 service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:48:54.336669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98248bb-e802-4f34-a0d8-dd3c66fc0285 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:48:54.346622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98248bb-e802-4f34-a0d8-dd3c66fc0285 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:48:54.348246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98248bb-e802-4f34-a0d8-dd3c66fc0285 service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:48:54.357746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1144/2256] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:48:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:49:04.154813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=41 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:04.353735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:06.213162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96862d-1c00-45f7-abca-3c6a6428fb4b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:06.213679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96862d-1c00-45f7-abca-3c6a6428fb4b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:06.213679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96862d-1c00-45f7-abca-3c6a6428fb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:06.231288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4e96862d-1c00-45f7-abca-3c6a6428fb4b None None] MFA Rules not processed for user `3d8a088405d549cda80615fd41a661c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:06.232506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4e96862d-1c00-45f7-abca-3c6a6428fb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:06.239945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1113/2257] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:08.911005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98248bb-e802-4f34-a0d8-dd3c66fc0285 service swift] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:08.976211 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98248bb-e802-4f34-a0d8-dd3c66fc0285 service swift] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:08.980699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:08.981561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:08.981842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:08.982116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] PATH_INFO: `/v3/users/f7662fbecc844dcabbbd224577864644` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:08.983412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7662fbecc844dcabbbd224577864644)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:08.989513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:09.200269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7662fbecc844dcabbbd224577864644'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:09.352576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7662fbecc844dcabbbd224577864644'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:09.353173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7662fbecc844dcabbbd224577864644'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:09.353791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7662fbecc844dcabbbd224577864644'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:09.361709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7662fbecc844dcabbbd224577864644'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:09.379744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1145/2258] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:49:08 2022] DELETE /identity/v3/users/f7662fbecc844dcabbbd224577864644 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:49:09.384247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496758-4029-4c75-b65b-971228c22152 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:09.384770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496758-4029-4c75-b65b-971228c22152 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:09.389838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496758-4029-4c75-b65b-971228c22152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:09.402353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d6496758-4029-4c75-b65b-971228c22152 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:09.403512 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d6496758-4029-4c75-b65b-971228c22152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:09.466386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1114/2259] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:49:09.476577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:09.478213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:09.542430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810a4d-4285-43f8-bf66-29422a3eefb5 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:09.546428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7996a-903e-4c51-b709-0a4593549be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:09.547078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7996a-903e-4c51-b709-0a4593549be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:09.547373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7996a-903e-4c51-b709-0a4593549be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:09.548209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7996a-903e-4c51-b709-0a4593549be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:09.558212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7996a-903e-4c51-b709-0a4593549be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:09.561320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7996a-903e-4c51-b709-0a4593549be4 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:09.573021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1146/2260] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:49:10.089120 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6496758-4029-4c75-b65b-971228c22152 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:10.094083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d6496758-4029-4c75-b65b-971228c22152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:10.104171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6496758-4029-4c75-b65b-971228c22152 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:10.111463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:10.112595 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:10.112973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:10.113363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] PATH_INFO: `/v3/projects/76b9d240f85540c5bb0645d0612dd064` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:10.114840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b9d240f85540c5bb0645d0612dd064)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:10.117438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:10.255793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b9d240f85540c5bb0645d0612dd064', 'request_id': 'req-bcf9a0df-6712-42ed-94aa-e6f38da57e23'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:10.323396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b9d240f85540c5bb0645d0612dd064', 'request_id': 'req-bcf9a0df-6712-42ed-94aa-e6f38da57e23'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:10.330627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b9d240f85540c5bb0645d0612dd064', 'request_id': 'req-bcf9a0df-6712-42ed-94aa-e6f38da57e23'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:10.341612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] The token cache is being invalidate because project 76b9d240f85540c5bb0645d0612dd064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:49:10.341903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:10.342541 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bcf9a0df-6712-42ed-94aa-e6f38da57e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:10.344088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1115/2261] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:49:10 2022] DELETE /identity/v3/projects/76b9d240f85540c5bb0645d0612dd064 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:49:10.349917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce958c-630c-4f14-a9c1-4f20ea518c1d None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:10.350545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce958c-630c-4f14-a9c1-4f20ea518c1d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:10.350685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce958c-630c-4f14-a9c1-4f20ea518c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:10.369118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-11ce958c-630c-4f14-a9c1-4f20ea518c1d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:10.370375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-11ce958c-630c-4f14-a9c1-4f20ea518c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:10.387239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:10.428656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1147/2262] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:10.436449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24d9dc-240a-4f3c-85e2-162c784b4ff7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:10.436949 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24d9dc-240a-4f3c-85e2-162c784b4ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:10.437082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24d9dc-240a-4f3c-85e2-162c784b4ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:10.455960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6c24d9dc-240a-4f3c-85e2-162c784b4ff7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:10.457476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6c24d9dc-240a-4f3c-85e2-162c784b4ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:10.465604 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1116/2263] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:10.470155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce958c-630c-4f14-a9c1-4f20ea518c1d None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:10.479897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce958c-630c-4f14-a9c1-4f20ea518c1d None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:10.484537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dc145-8bd7-458e-8934-537bc8cf0cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:10.485990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dc145-8bd7-458e-8934-537bc8cf0cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:10.486459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dc145-8bd7-458e-8934-537bc8cf0cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:10.486745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dc145-8bd7-458e-8934-537bc8cf0cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:10.487482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dc145-8bd7-458e-8934-537bc8cf0cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:49:10.487814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dc145-8bd7-458e-8934-537bc8cf0cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:10.489505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dc145-8bd7-458e-8934-537bc8cf0cbe admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:10.502171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1148/2264] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:49:10.513107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24d9dc-240a-4f3c-85e2-162c784b4ff7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:10.523512 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24d9dc-240a-4f3c-85e2-162c784b4ff7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:10.528288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14477dc-c46b-4eef-8015-679c43c291ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:10.528970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14477dc-c46b-4eef-8015-679c43c291ca admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:10.529255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14477dc-c46b-4eef-8015-679c43c291ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:10.529532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14477dc-c46b-4eef-8015-679c43c291ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:10.530231 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14477dc-c46b-4eef-8015-679c43c291ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:10.532195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14477dc-c46b-4eef-8015-679c43c291ca admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:10.660087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1117/2265] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:49:10 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:49:10.664208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dc145-8bd7-458e-8934-537bc8cf0cbe admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:10.674995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dc145-8bd7-458e-8934-537bc8cf0cbe admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:10.735489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9504946-8a93-4feb-b81e-529f854d36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:10.736080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9504946-8a93-4feb-b81e-529f854d36eb admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:10.736392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9504946-8a93-4feb-b81e-529f854d36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:10.736813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9504946-8a93-4feb-b81e-529f854d36eb admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:10.737496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9504946-8a93-4feb-b81e-529f854d36eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:10.739484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9504946-8a93-4feb-b81e-529f854d36eb admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:10.860989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1149/2266] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:49:10 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:49:10.865039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14477dc-c46b-4eef-8015-679c43c291ca admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:10.875507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14477dc-c46b-4eef-8015-679c43c291ca admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:10.880950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d8c83-ee2c-4474-9782-b1d33545b942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:10.881610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d8c83-ee2c-4474-9782-b1d33545b942 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:10.881926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d8c83-ee2c-4474-9782-b1d33545b942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:10.882206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d8c83-ee2c-4474-9782-b1d33545b942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:10.882934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d8c83-ee2c-4474-9782-b1d33545b942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:10.884619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d8c83-ee2c-4474-9782-b1d33545b942 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:10.895909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1118/2267] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:49:10.904127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9504946-8a93-4feb-b81e-529f854d36eb admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:10.914604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9504946-8a93-4feb-b81e-529f854d36eb admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:10.919337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac44c6-8919-4118-a3ad-f48494ab49e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:10.920017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac44c6-8919-4118-a3ad-f48494ab49e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:10.920322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac44c6-8919-4118-a3ad-f48494ab49e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:10.920610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac44c6-8919-4118-a3ad-f48494ab49e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:10.921366 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac44c6-8919-4118-a3ad-f48494ab49e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:10.922991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac44c6-8919-4118-a3ad-f48494ab49e8 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:10.932975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1150/2268] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:49:10.936905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d8c83-ee2c-4474-9782-b1d33545b942 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:10.947788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d8c83-ee2c-4474-9782-b1d33545b942 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:10.952402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4227c-00cf-49a8-a000-179b7d36622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:10.953273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4227c-00cf-49a8-a000-179b7d36622d admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:10.953560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4227c-00cf-49a8-a000-179b7d36622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:10.953871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4227c-00cf-49a8-a000-179b7d36622d admin admin] PATH_INFO: `/v3/projects/a6ed77e2b37c47d9b99fcb93fa4977c9/users/9acaaff9694e48f88d15208aca793f2c/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:10.973928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4227c-00cf-49a8-a000-179b7d36622d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ed77e2b37c47d9b99fcb93fa4977c9, user_id=9acaaff9694e48f88d15208aca793f2c, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:10.976715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4227c-00cf-49a8-a000-179b7d36622d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:11.055881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1119/2269] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:49:10 2022] PUT /identity/v3/projects/a6ed77e2b37c47d9b99fcb93fa4977c9/users/9acaaff9694e48f88d15208aca793f2c/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:49:11.067499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6d2b8-832a-4de2-8670-8506ce4041b9 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:11.067891 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6d2b8-832a-4de2-8670-8506ce4041b9 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:11.068226 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6d2b8-832a-4de2-8670-8506ce4041b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:11.096462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-dea6d2b8-832a-4de2-8670-8506ce4041b9 None None] MFA Rules not processed for user `9acaaff9694e48f88d15208aca793f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:11.097727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-dea6d2b8-832a-4de2-8670-8506ce4041b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:11.162392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1151/2270] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:11.173528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4227c-00cf-49a8-a000-179b7d36622d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:11.175928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c3a4227c-00cf-49a8-a000-179b7d36622d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:11.191179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:11.245018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4227c-00cf-49a8-a000-179b7d36622d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:11.248909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab98ade-91b6-4f96-a9d4-14d10e2b0b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:11.249567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98ade-91b6-4f96-a9d4-14d10e2b0b95 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:11.249853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98ade-91b6-4f96-a9d4-14d10e2b0b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:11.250133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98ade-91b6-4f96-a9d4-14d10e2b0b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:11.260561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab98ade-91b6-4f96-a9d4-14d10e2b0b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:11.262437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab98ade-91b6-4f96-a9d4-14d10e2b0b95 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:11.271844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1120/2271] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:49:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:49:13.089908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b047d-8ba8-4bbe-bf24-abe825e48b33 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:13.090389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b047d-8ba8-4bbe-bf24-abe825e48b33 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:13.090483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b047d-8ba8-4bbe-bf24-abe825e48b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:13.109782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-bc9b047d-8ba8-4bbe-bf24-abe825e48b33 None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:13.110995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bc9b047d-8ba8-4bbe-bf24-abe825e48b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:13.123615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:13.174863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1152/2272] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:13.206553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab98ade-91b6-4f96-a9d4-14d10e2b0b95 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:13.206553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-eab98ade-91b6-4f96-a9d4-14d10e2b0b95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:13.294879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab98ade-91b6-4f96-a9d4-14d10e2b0b95 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:13.300227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578c8b-4acb-4eef-b435-46715c442a1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:13.301010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578c8b-4acb-4eef-b435-46715c442a1e service swift] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:13.301283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578c8b-4acb-4eef-b435-46715c442a1e service swift] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:13.301560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578c8b-4acb-4eef-b435-46715c442a1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:13.311235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94578c8b-4acb-4eef-b435-46715c442a1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:13.312940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94578c8b-4acb-4eef-b435-46715c442a1e service swift] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:13.323196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1121/2273] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:49:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:49:23.318387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=52 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:23.380263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=17 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:33.695194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad4bf-e8a6-4b70-ad45-0c6de1756141 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:33.695839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad4bf-e8a6-4b70-ad45-0c6de1756141 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:33.695839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad4bf-e8a6-4b70-ad45-0c6de1756141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:33.715126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-55aad4bf-e8a6-4b70-ad45-0c6de1756141 None None] MFA Rules not processed for user `718a82d2f4294f68965ce01aac0fc166`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:33.716531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-55aad4bf-e8a6-4b70-ad45-0c6de1756141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:33.774570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1153/2274] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:43.766914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=25 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:44.063919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578c8b-4acb-4eef-b435-46715c442a1e service swift] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:44.128936 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578c8b-4acb-4eef-b435-46715c442a1e service swift] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:44.133841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:44.139663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:44.139663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:44.139663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] PATH_INFO: `/v3/users/9acaaff9694e48f88d15208aca793f2c` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:44.139663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9acaaff9694e48f88d15208aca793f2c)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:44.139663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:44.395496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9acaaff9694e48f88d15208aca793f2c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:44.396258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9acaaff9694e48f88d15208aca793f2c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:44.403637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9acaaff9694e48f88d15208aca793f2c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:44.417236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9acaaff9694e48f88d15208aca793f2c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:44.476246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9acaaff9694e48f88d15208aca793f2c'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:44.484638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1122/2275] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:49:44 2022] DELETE /identity/v3/users/9acaaff9694e48f88d15208aca793f2c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:49:44.489373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b42487-b8c1-4054-be5f-f2ab15f262c5 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:44.489747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b42487-b8c1-4054-be5f-f2ab15f262c5 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:44.490252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b42487-b8c1-4054-be5f-f2ab15f262c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:44.510163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-02b42487-b8c1-4054-be5f-f2ab15f262c5 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:44.511511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-02b42487-b8c1-4054-be5f-f2ab15f262c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:44.572071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1154/2276] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:44.581919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:44.583789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:44.642275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ca9f8-8a27-4815-937b-b21b2f925f65 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:44.645890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722fe9a-4eb2-496b-a305-3c9bdf00305b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:44.646535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722fe9a-4eb2-496b-a305-3c9bdf00305b service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:44.646817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722fe9a-4eb2-496b-a305-3c9bdf00305b service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:44.647094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722fe9a-4eb2-496b-a305-3c9bdf00305b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:44.656274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722fe9a-4eb2-496b-a305-3c9bdf00305b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:44.657739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722fe9a-4eb2-496b-a305-3c9bdf00305b service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:44.667083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1123/2277] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:49:45.068741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b42487-b8c1-4054-be5f-f2ab15f262c5 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:45.070253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-02b42487-b8c1-4054-be5f-f2ab15f262c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:45.084271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b42487-b8c1-4054-be5f-f2ab15f262c5 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:45.096688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:45.096688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:45.096688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:45.096688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] PATH_INFO: `/v3/projects/a6ed77e2b37c47d9b99fcb93fa4977c9` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:45.097093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ed77e2b37c47d9b99fcb93fa4977c9)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:45.097182 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:45.274233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ed77e2b37c47d9b99fcb93fa4977c9', 'request_id': 'req-cbe32563-e141-4cf2-badf-89f8abef68a5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:45.280158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ed77e2b37c47d9b99fcb93fa4977c9', 'request_id': 'req-cbe32563-e141-4cf2-badf-89f8abef68a5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:45.358631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ed77e2b37c47d9b99fcb93fa4977c9', 'request_id': 'req-cbe32563-e141-4cf2-badf-89f8abef68a5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:45.370783 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] The token cache is being invalidate because project a6ed77e2b37c47d9b99fcb93fa4977c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:49:45.371071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:45.371711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-cbe32563-e141-4cf2-badf-89f8abef68a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:45.373386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1155/2278] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:49:45 2022] DELETE /identity/v3/projects/a6ed77e2b37c47d9b99fcb93fa4977c9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:49:45.378540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5770e1-f8cb-4d74-af18-2fb8d0c04973 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:45.379024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5770e1-f8cb-4d74-af18-2fb8d0c04973 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:45.379137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5770e1-f8cb-4d74-af18-2fb8d0c04973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:45.398207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-ae5770e1-f8cb-4d74-af18-2fb8d0c04973 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:45.399415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ae5770e1-f8cb-4d74-af18-2fb8d0c04973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:45.418803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:45.471919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1124/2279] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:45.483198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606bfe-7ed2-4d58-80a1-2d99eb567fb1 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:45.483483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606bfe-7ed2-4d58-80a1-2d99eb567fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:45.483784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606bfe-7ed2-4d58-80a1-2d99eb567fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:45.504361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7c606bfe-7ed2-4d58-80a1-2d99eb567fb1 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:45.505699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7c606bfe-7ed2-4d58-80a1-2d99eb567fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:45.515238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1156/2280] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:45.519414 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5770e1-f8cb-4d74-af18-2fb8d0c04973 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:45.530251 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5770e1-f8cb-4d74-af18-2fb8d0c04973 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:45.535530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4dce-d5d5-4ab1-883e-67f1e4bbeb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:45.536197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4dce-d5d5-4ab1-883e-67f1e4bbeb9b admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:45.536516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4dce-d5d5-4ab1-883e-67f1e4bbeb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:45.536911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4dce-d5d5-4ab1-883e-67f1e4bbeb9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:45.538006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc4dce-d5d5-4ab1-883e-67f1e4bbeb9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:49:45.538323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc4dce-d5d5-4ab1-883e-67f1e4bbeb9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:45.540344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc4dce-d5d5-4ab1-883e-67f1e4bbeb9b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:45.556442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1125/2281] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:49:45.557805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c606bfe-7ed2-4d58-80a1-2d99eb567fb1 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:45.568161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c606bfe-7ed2-4d58-80a1-2d99eb567fb1 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:45.573501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4d6f2-28b5-4ee9-9288-6d81c93511d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:45.574754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d6f2-28b5-4ee9-9288-6d81c93511d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:45.574754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d6f2-28b5-4ee9-9288-6d81c93511d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:45.574754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d6f2-28b5-4ee9-9288-6d81c93511d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:45.575397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4d6f2-28b5-4ee9-9288-6d81c93511d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:45.577969 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4d6f2-28b5-4ee9-9288-6d81c93511d3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:45.658096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1157/2282] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:49:45 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:49:45.659643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4dce-d5d5-4ab1-883e-67f1e4bbeb9b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:45.670307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4dce-d5d5-4ab1-883e-67f1e4bbeb9b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:45.731513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a9928-63f7-4acb-9e21-54a3567ca746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:45.732479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9928-63f7-4acb-9e21-54a3567ca746 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:45.733195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9928-63f7-4acb-9e21-54a3567ca746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:45.733195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9928-63f7-4acb-9e21-54a3567ca746 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:45.733967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a9928-63f7-4acb-9e21-54a3567ca746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:45.735898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a9928-63f7-4acb-9e21-54a3567ca746 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:45.825665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1126/2283] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:49:45 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:49:45.831206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4d6f2-28b5-4ee9-9288-6d81c93511d3 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:45.842590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4d6f2-28b5-4ee9-9288-6d81c93511d3 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:45.847487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db1015-962c-4bf7-a2af-8b68718a6543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:45.848166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db1015-962c-4bf7-a2af-8b68718a6543 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:45.848491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db1015-962c-4bf7-a2af-8b68718a6543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:45.848773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db1015-962c-4bf7-a2af-8b68718a6543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:45.849504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db1015-962c-4bf7-a2af-8b68718a6543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:45.851146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db1015-962c-4bf7-a2af-8b68718a6543 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:45.862750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1158/2284] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:49:45.867084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a9928-63f7-4acb-9e21-54a3567ca746 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:45.878244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a9928-63f7-4acb-9e21-54a3567ca746 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:45.883310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695a077-7a36-4a9b-91b1-d2270e2b6bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:45.884052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695a077-7a36-4a9b-91b1-d2270e2b6bde admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:45.884478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695a077-7a36-4a9b-91b1-d2270e2b6bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:45.884830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695a077-7a36-4a9b-91b1-d2270e2b6bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:45.885634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695a077-7a36-4a9b-91b1-d2270e2b6bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:45.887371 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695a077-7a36-4a9b-91b1-d2270e2b6bde admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:45.900913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1127/2285] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:49:45.902156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db1015-962c-4bf7-a2af-8b68718a6543 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:45.912457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db1015-962c-4bf7-a2af-8b68718a6543 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:45.917739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04d4f-c191-4333-8db2-9a82c9c37e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:45.918623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04d4f-c191-4333-8db2-9a82c9c37e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:45.918910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04d4f-c191-4333-8db2-9a82c9c37e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:45.919191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04d4f-c191-4333-8db2-9a82c9c37e36 admin admin] PATH_INFO: `/v3/projects/cb0ca44e74c744b8998bd391f12e1cb1/users/77cafb550d0a47b1989b5dce815b9f13/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:45.937494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae04d4f-c191-4333-8db2-9a82c9c37e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0ca44e74c744b8998bd391f12e1cb1, user_id=77cafb550d0a47b1989b5dce815b9f13, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:45.940359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae04d4f-c191-4333-8db2-9a82c9c37e36 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:46.042730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1159/2286] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:49:45 2022] PUT /identity/v3/projects/cb0ca44e74c744b8998bd391f12e1cb1/users/77cafb550d0a47b1989b5dce815b9f13/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:49:46.057608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c4a5-ffd2-47ab-a9ed-8ccc79364ffe None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:46.057608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c4a5-ffd2-47ab-a9ed-8ccc79364ffe None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:46.057608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c4a5-ffd2-47ab-a9ed-8ccc79364ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:46.085373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b3f3c4a5-ffd2-47ab-a9ed-8ccc79364ffe None None] MFA Rules not processed for user `77cafb550d0a47b1989b5dce815b9f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:46.086631 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b3f3c4a5-ffd2-47ab-a9ed-8ccc79364ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:46.155496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1128/2287] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:46.166125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04d4f-c191-4333-8db2-9a82c9c37e36 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:46.167833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bae04d4f-c191-4333-8db2-9a82c9c37e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:46.196934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:46.241000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04d4f-c191-4333-8db2-9a82c9c37e36 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:46.244711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763853e-392e-44cc-8d94-4002979df234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:46.245360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763853e-392e-44cc-8d94-4002979df234 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:46.245712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763853e-392e-44cc-8d94-4002979df234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:46.245998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763853e-392e-44cc-8d94-4002979df234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:46.255933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763853e-392e-44cc-8d94-4002979df234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:46.257468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763853e-392e-44cc-8d94-4002979df234 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:46.266742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1160/2288] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:49:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:49:51.518599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3c4a5-ffd2-47ab-a9ed-8ccc79364ffe None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:51.538928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:51.586759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3c4a5-ffd2-47ab-a9ed-8ccc79364ffe None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:51.603226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:51.603226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:51.603226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:51.603226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] PATH_INFO: `/v3/users/77cafb550d0a47b1989b5dce815b9f13` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:51.603645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77cafb550d0a47b1989b5dce815b9f13)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:51.603645 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:51.814031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77cafb550d0a47b1989b5dce815b9f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:51.814681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77cafb550d0a47b1989b5dce815b9f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:51.822299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77cafb550d0a47b1989b5dce815b9f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:51.836659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77cafb550d0a47b1989b5dce815b9f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:51.910480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77cafb550d0a47b1989b5dce815b9f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:51.916925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1129/2289] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:49:51 2022] DELETE /identity/v3/users/77cafb550d0a47b1989b5dce815b9f13 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:49:51.922209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05536b-4de7-4435-88a4-694c38964b03 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:51.922739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05536b-4de7-4435-88a4-694c38964b03 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:51.922834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05536b-4de7-4435-88a4-694c38964b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:51.941177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-cd05536b-4de7-4435-88a4-694c38964b03 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:51.942382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-cd05536b-4de7-4435-88a4-694c38964b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:52.004723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1161/2290] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:52.014506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:52.015959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:52.074940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5765-3137-4e85-a769-d80005d2bd91 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:52.078655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e076ee-488b-4e3b-ad96-84bafafe2e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:52.079306 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e076ee-488b-4e3b-ad96-84bafafe2e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:52.079593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e076ee-488b-4e3b-ad96-84bafafe2e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:52.079882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e076ee-488b-4e3b-ad96-84bafafe2e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:52.089565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e076ee-488b-4e3b-ad96-84bafafe2e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:52.091317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e076ee-488b-4e3b-ad96-84bafafe2e30 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:52.100957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1130/2291] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:49:53.102581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05536b-4de7-4435-88a4-694c38964b03 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:53.104287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-cd05536b-4de7-4435-88a4-694c38964b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:53.119865 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05536b-4de7-4435-88a4-694c38964b03 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:53.125457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:53.130764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:53.130764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:53.130764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] PATH_INFO: `/v3/projects/cb0ca44e74c744b8998bd391f12e1cb1` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:53.130764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0ca44e74c744b8998bd391f12e1cb1)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:53.130764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:53.228128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0ca44e74c744b8998bd391f12e1cb1', 'request_id': 'req-e27d99de-4f3c-4d75-a628-a578b6a78458'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:53.233794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0ca44e74c744b8998bd391f12e1cb1', 'request_id': 'req-e27d99de-4f3c-4d75-a628-a578b6a78458'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:53.304786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0ca44e74c744b8998bd391f12e1cb1', 'request_id': 'req-e27d99de-4f3c-4d75-a628-a578b6a78458'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:53.317068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] The token cache is being invalidate because project cb0ca44e74c744b8998bd391f12e1cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:49:53.317360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:53.318013 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:49:53.319594 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1162/2292] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:49:53 2022] DELETE /identity/v3/projects/cb0ca44e74c744b8998bd391f12e1cb1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:49:55.015480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64edc-00d7-4a95-99b7-d883327380de None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:55.016001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64edc-00d7-4a95-99b7-d883327380de None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:55.016001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64edc-00d7-4a95-99b7-d883327380de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:55.044193 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6fa64edc-00d7-4a95-99b7-d883327380de None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:49:55.046951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6fa64edc-00d7-4a95-99b7-d883327380de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:55.087042 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:55.114457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1131/2293] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:49:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:49:55.142540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:49:55.143984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:49:55.202679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:55.237329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d99de-4f3c-4d75-a628-a578b6a78458 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:49:55.244628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471125a3-288e-408a-a1f3-9cd3b00ba442 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:49:55.245362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471125a3-288e-408a-a1f3-9cd3b00ba442 service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:49:55.245721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471125a3-288e-408a-a1f3-9cd3b00ba442 service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:49:55.246073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471125a3-288e-408a-a1f3-9cd3b00ba442 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:49:55.257152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471125a3-288e-408a-a1f3-9cd3b00ba442 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:49:55.258754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471125a3-288e-408a-a1f3-9cd3b00ba442 service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:49:55.268199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1163/2294] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:49:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:50:03.269243 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa64edc-00d7-4a95-99b7-d883327380de None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:50:03.270702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6fa64edc-00d7-4a95-99b7-d883327380de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:03.358195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa64edc-00d7-4a95-99b7-d883327380de None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:50:03.371848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf829fd6-9580-4712-98af-fd39b7e9b43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:50:03.372818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829fd6-9580-4712-98af-fd39b7e9b43a service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:03.373106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829fd6-9580-4712-98af-fd39b7e9b43a service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:03.373382 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829fd6-9580-4712-98af-fd39b7e9b43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:03.377200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-bf829fd6-9580-4712-98af-fd39b7e9b43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:03.465922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf829fd6-9580-4712-98af-fd39b7e9b43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:50:03.467412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf829fd6-9580-4712-98af-fd39b7e9b43a service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:50:03.478473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1132/2295] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:50:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:50:05.619552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=11 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:12.726765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e4c1d-3b8c-460c-a0c8-8af54cd9c500 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:12.727417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e4c1d-3b8c-460c-a0c8-8af54cd9c500 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:12.727417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e4c1d-3b8c-460c-a0c8-8af54cd9c500 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:12.728974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1164/2296] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:50:12.735002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3eb44-392f-482d-975d-6abe12150780 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:12.735493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3eb44-392f-482d-975d-6abe12150780 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:12.735643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3eb44-392f-482d-975d-6abe12150780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:12.788442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-bef3eb44-392f-482d-975d-6abe12150780 None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:50:12.789438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-bef3eb44-392f-482d-975d-6abe12150780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:12.859076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:12.874959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1133/2297] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:50:12.882758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e4c1d-3b8c-460c-a0c8-8af54cd9c500 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:50:12.884480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-844e4c1d-3b8c-460c-a0c8-8af54cd9c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:12.951672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e4c1d-3b8c-460c-a0c8-8af54cd9c500 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:50:12.955215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030e0fa-c3aa-4277-834a-fc9fbd8be2be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9533e8371e64161a4c54eeab867a17e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:50:12.955973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030e0fa-c3aa-4277-834a-fc9fbd8be2be service glance] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:12.956256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030e0fa-c3aa-4277-834a-fc9fbd8be2be service glance] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:12.956561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030e0fa-c3aa-4277-834a-fc9fbd8be2be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:12.966812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030e0fa-c3aa-4277-834a-fc9fbd8be2be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:50:12.968236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030e0fa-c3aa-4277-834a-fc9fbd8be2be service glance] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:50:12.979367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1165/2298] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:50:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:50:13.169575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341c56a-fcc5-42c4-b217-4cd1d1b30cad None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:13.169765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341c56a-fcc5-42c4-b217-4cd1d1b30cad None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:13.170049 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341c56a-fcc5-42c4-b217-4cd1d1b30cad None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:13.171422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1134/2299] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:50:13.176843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539d60-5772-45ba-8ca3-b88a1d32bd1b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:13.178315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539d60-5772-45ba-8ca3-b88a1d32bd1b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:13.178315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539d60-5772-45ba-8ca3-b88a1d32bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:13.196459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-9e539d60-5772-45ba-8ca3-b88a1d32bd1b None None] MFA Rules not processed for user `a833149a66af4452aeedd5d43f2fb2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:50:13.197674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9e539d60-5772-45ba-8ca3-b88a1d32bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:13.204128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1166/2300] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:50:13.216142 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341c56a-fcc5-42c4-b217-4cd1d1b30cad None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:50:13.227583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341c56a-fcc5-42c4-b217-4cd1d1b30cad None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:50:13.231075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2a59f-4b52-472c-8f45-50b33035f046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:50:13.231755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2a59f-4b52-472c-8f45-50b33035f046 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:13.232043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2a59f-4b52-472c-8f45-50b33035f046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:13.232342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2a59f-4b52-472c-8f45-50b33035f046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:13.239983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2a59f-4b52-472c-8f45-50b33035f046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:50:13.241455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2a59f-4b52-472c-8f45-50b33035f046 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:50:13.252891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1135/2301] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:50:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:50:13.335682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ea5d-815c-48f9-8e0f-a38fa0555035 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:13.336039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ea5d-815c-48f9-8e0f-a38fa0555035 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:13.336352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ea5d-815c-48f9-8e0f-a38fa0555035 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:13.337746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1167/2302] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:50:13.342550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8ae6-f5ab-4bea-afb8-ec88ff8d6e4f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:13.342842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8ae6-f5ab-4bea-afb8-ec88ff8d6e4f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:13.343123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8ae6-f5ab-4bea-afb8-ec88ff8d6e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:13.361772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-f24b8ae6-f5ab-4bea-afb8-ec88ff8d6e4f None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:50:13.362990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f24b8ae6-f5ab-4bea-afb8-ec88ff8d6e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:13.372261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1136/2303] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:50:13.383419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ea5d-815c-48f9-8e0f-a38fa0555035 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:50:13.385140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b711ea5d-815c-48f9-8e0f-a38fa0555035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:13.398974 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ea5d-815c-48f9-8e0f-a38fa0555035 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:50:13.402580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9494fa8-287e-4e8e-8b6f-70e17f59dc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:50:13.403213 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9494fa8-287e-4e8e-8b6f-70e17f59dc4d service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:13.403501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9494fa8-287e-4e8e-8b6f-70e17f59dc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:13.403781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9494fa8-287e-4e8e-8b6f-70e17f59dc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:13.413921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9494fa8-287e-4e8e-8b6f-70e17f59dc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:50:13.415355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9494fa8-287e-4e8e-8b6f-70e17f59dc4d service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:50:13.426769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1168/2304] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:50:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:50:17.237718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d34768-0597-4af8-bfb7-cc40c3c09bcd None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:17.238183 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d34768-0597-4af8-bfb7-cc40c3c09bcd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:17.238276 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d34768-0597-4af8-bfb7-cc40c3c09bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:17.259568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d5d34768-0597-4af8-bfb7-cc40c3c09bcd None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:50:17.260835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d5d34768-0597-4af8-bfb7-cc40c3c09bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:17.269482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1137/2305] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:50:17.281767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9494fa8-287e-4e8e-8b6f-70e17f59dc4d service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:50:17.294520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9494fa8-287e-4e8e-8b6f-70e17f59dc4d service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:50:17.300678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe1e60-59fb-4725-9da5-2c75333ab267 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:50:17.301362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe1e60-59fb-4725-9da5-2c75333ab267 service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:17.301655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe1e60-59fb-4725-9da5-2c75333ab267 service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:17.301936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe1e60-59fb-4725-9da5-2c75333ab267 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:17.310616 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe1e60-59fb-4725-9da5-2c75333ab267 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:50:17.312254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe1e60-59fb-4725-9da5-2c75333ab267 service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:50:17.321849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1169/2306] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:50:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:50:27.253501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=15 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:27.318027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=41 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:29.560269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d34768-0597-4af8-bfb7-cc40c3c09bcd None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:50:29.570703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d34768-0597-4af8-bfb7-cc40c3c09bcd None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:50:29.574212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:50:29.574852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:29.575135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:29.575412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:29.577220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:29.590707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:50:29.592128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:50:29.603474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1138/2307] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:50:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:50:30.991325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe1e60-59fb-4725-9da5-2c75333ab267 service swift] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:50:30.992759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bcbe1e60-59fb-4725-9da5-2c75333ab267 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:31.049628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe1e60-59fb-4725-9da5-2c75333ab267 service swift] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:50:31.053250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5002b-ea07-4393-a68f-c1c6876654b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:50:31.053893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5002b-ea07-4393-a68f-c1c6876654b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:31.054175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5002b-ea07-4393-a68f-c1c6876654b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:31.054453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5002b-ea07-4393-a68f-c1c6876654b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:31.056219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1ad5002b-ea07-4393-a68f-c1c6876654b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:31.069702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5002b-ea07-4393-a68f-c1c6876654b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:50:31.071129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5002b-ea07-4393-a68f-c1c6876654b6 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:50:31.082322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1170/2308] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:50:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:50:39.598852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=6 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:41.077199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=26 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:44.053728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:50:44.055215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:44.076365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f51f6-affc-43f9-95c3-31ef6bdc3151 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:50:44.082812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8bd7b-6b3e-4dee-9274-e9c616edf9ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:50:44.083458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8bd7b-6b3e-4dee-9274-e9c616edf9ce service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:44.084006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8bd7b-6b3e-4dee-9274-e9c616edf9ce service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:44.084284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8bd7b-6b3e-4dee-9274-e9c616edf9ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:44.086067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-73d8bd7b-6b3e-4dee-9274-e9c616edf9ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:44.144355 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8bd7b-6b3e-4dee-9274-e9c616edf9ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:50:44.146064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8bd7b-6b3e-4dee-9274-e9c616edf9ce service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:50:44.155504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1139/2309] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:50:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:50:44.722136 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98357c2-7e8d-4c89-bcfa-0b1435aea629 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:44.722604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98357c2-7e8d-4c89-bcfa-0b1435aea629 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:44.722700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98357c2-7e8d-4c89-bcfa-0b1435aea629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:44.740481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-e98357c2-7e8d-4c89-bcfa-0b1435aea629 None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:50:44.741684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e98357c2-7e8d-4c89-bcfa-0b1435aea629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:50:44.748871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1171/2310] 10.222.0.74 () {58 vars in 967 bytes} [Mon May 23 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:50:44.761083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8bd7b-6b3e-4dee-9274-e9c616edf9ce service nova] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:50:44.772642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8bd7b-6b3e-4dee-9274-e9c616edf9ce service nova] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:50:44.777696 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f0bf7-5e7c-4aeb-81a1-7b81915b4fa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:50:44.778366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f0bf7-5e7c-4aeb-81a1-7b81915b4fa7 service swift] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:50:44.778657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f0bf7-5e7c-4aeb-81a1-7b81915b4fa7 service swift] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:50:44.778938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f0bf7-5e7c-4aeb-81a1-7b81915b4fa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:50:44.787789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f0bf7-5e7c-4aeb-81a1-7b81915b4fa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:50:44.789432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f0bf7-5e7c-4aeb-81a1-7b81915b4fa7 service swift] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:50:44.797581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1140/2311] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:50:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:50:54.735024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:54.794264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=34 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:00.426580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98357c2-7e8d-4c89-bcfa-0b1435aea629 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:51:00.435839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98357c2-7e8d-4c89-bcfa-0b1435aea629 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:51:00.439472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:51:00.440103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:00.440420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:00.440696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:00.442413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:00.452499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:51:00.453937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:51:00.462736 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1172/2312] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:51:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:51:03.220782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99b0e1-1bc4-440c-b228-f753f258813c None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:03.220782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99b0e1-1bc4-440c-b228-f753f258813c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:03.220782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99b0e1-1bc4-440c-b228-f753f258813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:03.236145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-db99b0e1-1bc4-440c-b228-f753f258813c None None] MFA Rules not processed for user `f14f77bc65fd4ff0bc1ec6de35846f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:51:03.237384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-db99b0e1-1bc4-440c-b228-f753f258813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:03.244828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1141/2313] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:51:09.468937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:51:09.470546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:09.488887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e493b-4be7-4736-81f5-81d99682a476 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:51:09.495407 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c871de-656a-4d93-a118-a346228c4f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:51:09.496063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c871de-656a-4d93-a118-a346228c4f68 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:09.496386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c871de-656a-4d93-a118-a346228c4f68 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:09.496669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c871de-656a-4d93-a118-a346228c4f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:09.499034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-98c871de-656a-4d93-a118-a346228c4f68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:09.511561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c871de-656a-4d93-a118-a346228c4f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:51:09.513338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c871de-656a-4d93-a118-a346228c4f68 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:51:09.525670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1173/2314] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:51:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:51:13.230793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:19.521064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=12 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:26.297497 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99b0e1-1bc4-440c-b228-f753f258813c None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:51:26.310165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99b0e1-1bc4-440c-b228-f753f258813c None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:51:26.315842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b42525-3c98-4b2c-b0d9-e722e11c4c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:51:26.316516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42525-3c98-4b2c-b0d9-e722e11c4c5d service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:26.316801 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42525-3c98-4b2c-b0d9-e722e11c4c5d service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:26.317082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42525-3c98-4b2c-b0d9-e722e11c4c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:26.318857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f6b42525-3c98-4b2c-b0d9-e722e11c4c5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:26.376541 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b42525-3c98-4b2c-b0d9-e722e11c4c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:51:26.378138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b42525-3c98-4b2c-b0d9-e722e11c4c5d service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:51:26.387202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1142/2315] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:51:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:51:36.382866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=28 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:40.618888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c871de-656a-4d93-a118-a346228c4f68 service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:51:40.634205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c871de-656a-4d93-a118-a346228c4f68 service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:51:40.635980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10e69a-3e2e-4dcc-ba7e-c42a4a3bceef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:51:40.636671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10e69a-3e2e-4dcc-ba7e-c42a4a3bceef service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:40.636965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10e69a-3e2e-4dcc-ba7e-c42a4a3bceef service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:40.637238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10e69a-3e2e-4dcc-ba7e-c42a4a3bceef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:40.639175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5a10e69a-3e2e-4dcc-ba7e-c42a4a3bceef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:40.719127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10e69a-3e2e-4dcc-ba7e-c42a4a3bceef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:51:40.720850 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10e69a-3e2e-4dcc-ba7e-c42a4a3bceef service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:51:40.730539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1174/2316] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:51:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:51:43.758695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6e8b-abc8-4307-b1d5-9abfc9382dc7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:43.759230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6e8b-abc8-4307-b1d5-9abfc9382dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:43.759479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6e8b-abc8-4307-b1d5-9abfc9382dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:43.779821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9fcb6e8b-abc8-4307-b1d5-9abfc9382dc7 None None] MFA Rules not processed for user `718a82d2f4294f68965ce01aac0fc166`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:51:43.781641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9fcb6e8b-abc8-4307-b1d5-9abfc9382dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:43.789196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1143/2317] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:51:44.111280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10e69a-3e2e-4dcc-ba7e-c42a4a3bceef service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:51:44.120569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10e69a-3e2e-4dcc-ba7e-c42a4a3bceef service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:51:44.124107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476330d1-7959-4843-b2b4-866eeebee12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:51:44.124769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476330d1-7959-4843-b2b4-866eeebee12b service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:44.125055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476330d1-7959-4843-b2b4-866eeebee12b service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:44.125336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476330d1-7959-4843-b2b4-866eeebee12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:44.127132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-476330d1-7959-4843-b2b4-866eeebee12b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:44.136544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476330d1-7959-4843-b2b4-866eeebee12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:51:44.137933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476330d1-7959-4843-b2b4-866eeebee12b service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:51:44.145900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1175/2318] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:51:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:51:44.508925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb6e8b-abc8-4307-b1d5-9abfc9382dc7 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:51:44.510486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9fcb6e8b-abc8-4307-b1d5-9abfc9382dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:44.583367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb6e8b-abc8-4307-b1d5-9abfc9382dc7 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:51:44.588515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f48a3a-55ee-4342-9fdb-6036fe9de65a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:51:44.589211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f48a3a-55ee-4342-9fdb-6036fe9de65a service placement] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:44.589491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f48a3a-55ee-4342-9fdb-6036fe9de65a service placement] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:44.589765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f48a3a-55ee-4342-9fdb-6036fe9de65a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:44.591540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d4f48a3a-55ee-4342-9fdb-6036fe9de65a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:44.603145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f48a3a-55ee-4342-9fdb-6036fe9de65a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:51:44.604763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f48a3a-55ee-4342-9fdb-6036fe9de65a service placement] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:51:44.614472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1144/2319] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:51:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:51:53.153189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476330d1-7959-4843-b2b4-866eeebee12b service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:51:53.166417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476330d1-7959-4843-b2b4-866eeebee12b service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:51:53.172147 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c92f79-47c4-455b-91a8-9d744851961a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:51:53.172817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92f79-47c4-455b-91a8-9d744851961a service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:53.173104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92f79-47c4-455b-91a8-9d744851961a service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:53.173380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92f79-47c4-455b-91a8-9d744851961a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:53.175117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-91c92f79-47c4-455b-91a8-9d744851961a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:53.234633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c92f79-47c4-455b-91a8-9d744851961a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:51:53.236315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c92f79-47c4-455b-91a8-9d744851961a service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:51:53.245484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1176/2320] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:51:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:51:54.610348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=35 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:56.214031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f48a3a-55ee-4342-9fdb-6036fe9de65a service placement] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:51:56.227603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f48a3a-55ee-4342-9fdb-6036fe9de65a service placement] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:51:56.233791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031d9a-5f09-4c9e-b46b-c358b1b6dc01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:51:56.234439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031d9a-5f09-4c9e-b46b-c358b1b6dc01 service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:56.234724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031d9a-5f09-4c9e-b46b-c358b1b6dc01 service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:56.235002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031d9a-5f09-4c9e-b46b-c358b1b6dc01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:56.236833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-78031d9a-5f09-4c9e-b46b-c358b1b6dc01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:56.252837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78031d9a-5f09-4c9e-b46b-c358b1b6dc01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:51:56.252837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78031d9a-5f09-4c9e-b46b-c358b1b6dc01 service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:51:56.261473 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1145/2321] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:51:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:51:58.908767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c92f79-47c4-455b-91a8-9d744851961a service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:51:58.921449 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c92f79-47c4-455b-91a8-9d744851961a service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:51:58.928265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6722-2f80-4526-904b-1551c0e18d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:51:58.929014 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6722-2f80-4526-904b-1551c0e18d6b service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:51:58.929306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6722-2f80-4526-904b-1551c0e18d6b service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:51:58.929615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6722-2f80-4526-904b-1551c0e18d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:51:58.931677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ec1c6722-2f80-4526-904b-1551c0e18d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:51:58.948071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c6722-2f80-4526-904b-1551c0e18d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:51:58.949747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c6722-2f80-4526-904b-1551c0e18d6b service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:51:58.968177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1177/2322] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:51:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:04.222711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326066b-1a35-4c6f-95de-2098c8a6bc26 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:04.222711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326066b-1a35-4c6f-95de-2098c8a6bc26 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:04.222711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326066b-1a35-4c6f-95de-2098c8a6bc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:04.238643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a326066b-1a35-4c6f-95de-2098c8a6bc26 None None] MFA Rules not processed for user `29e2a2fa32cd4fb7837bdec1d83cb9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:04.239827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a326066b-1a35-4c6f-95de-2098c8a6bc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:04.246662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1146/2323] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:04.545939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6722-2f80-4526-904b-1551c0e18d6b service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:04.555321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6722-2f80-4526-904b-1551c0e18d6b service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:04.559005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:04.559706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:04.559992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:04.560857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:04.562960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:04.572444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:04.573874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:04.582437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1178/2324] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:14.233461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=9 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:14.578971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=74 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:29.018574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326066b-1a35-4c6f-95de-2098c8a6bc26 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:29.028623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326066b-1a35-4c6f-95de-2098c8a6bc26 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:29.032539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:29.033187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:29.033472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:29.033750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:29.035506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:29.098555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:29.100083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:29.110010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1147/2325] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:32.720536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:32.722067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:32.737679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67319c-b0ff-414e-a67a-3404314ebb24 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:32.742768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190f7ea-4af1-4c27-9f3e-2b3b7e6eb3a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:32.743412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190f7ea-4af1-4c27-9f3e-2b3b7e6eb3a3 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:32.743835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190f7ea-4af1-4c27-9f3e-2b3b7e6eb3a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:32.744122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190f7ea-4af1-4c27-9f3e-2b3b7e6eb3a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:32.746189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c190f7ea-4af1-4c27-9f3e-2b3b7e6eb3a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:32.758635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190f7ea-4af1-4c27-9f3e-2b3b7e6eb3a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:32.760364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190f7ea-4af1-4c27-9f3e-2b3b7e6eb3a3 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:32.772930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1179/2326] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:32.865407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:32.865407 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:32.877265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad2018-e3b5-4590-8219-f3beb9017c6c service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:32.881821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:32.882688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:32.882971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:32.883248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] PATH_INFO: `/v3/users/f14f77bc65fd4ff0bc1ec6de35846f14` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:32.884663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14f77bc65fd4ff0bc1ec6de35846f14)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:32.886749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:33.052895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14f77bc65fd4ff0bc1ec6de35846f14'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.053602 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14f77bc65fd4ff0bc1ec6de35846f14'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.062925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14f77bc65fd4ff0bc1ec6de35846f14'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.075206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14f77bc65fd4ff0bc1ec6de35846f14'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.152720 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ab946475-1ef0-46c4-8611-09d8d0c1d20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14f77bc65fd4ff0bc1ec6de35846f14'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.159987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1148/2327] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:52:32 2022] DELETE /identity/v3/users/f14f77bc65fd4ff0bc1ec6de35846f14 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:33.432085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190f7ea-4af1-4c27-9f3e-2b3b7e6eb3a3 service placement] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:33.444415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190f7ea-4af1-4c27-9f3e-2b3b7e6eb3a3 service placement] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:33.508323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:33.509182 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:33.509461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:33.509732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] PATH_INFO: `/v3/projects/8c4eba5d39e545cbb8380490c86045f0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:33.511016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4eba5d39e545cbb8380490c86045f0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:33.513080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:33.659043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4eba5d39e545cbb8380490c86045f0', 'request_id': 'req-3c228570-1707-4e76-908a-b0a3b36f56d7'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.664637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4eba5d39e545cbb8380490c86045f0', 'request_id': 'req-3c228570-1707-4e76-908a-b0a3b36f56d7'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.752570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4eba5d39e545cbb8380490c86045f0', 'request_id': 'req-3c228570-1707-4e76-908a-b0a3b36f56d7'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.764890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] The token cache is being invalidate because project 8c4eba5d39e545cbb8380490c86045f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:33.765066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.765694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3c228570-1707-4e76-908a-b0a3b36f56d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:33.767460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1180/2328] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:33 2022] DELETE /identity/v3/projects/8c4eba5d39e545cbb8380490c86045f0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:52:33.772345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850e9c3-77e5-4b2a-87a2-31838228a845 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:33.772641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850e9c3-77e5-4b2a-87a2-31838228a845 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:33.772919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850e9c3-77e5-4b2a-87a2-31838228a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:33.790386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2850e9c3-77e5-4b2a-87a2-31838228a845 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:33.791579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2850e9c3-77e5-4b2a-87a2-31838228a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:33.852220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1149/2329] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:33.860438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9fa0f-04d5-4716-983d-0be7d727fd99 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:33.860728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9fa0f-04d5-4716-983d-0be7d727fd99 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:33.861032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9fa0f-04d5-4716-983d-0be7d727fd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:33.879765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-faf9fa0f-04d5-4716-983d-0be7d727fd99 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:33.881018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-faf9fa0f-04d5-4716-983d-0be7d727fd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:33.889979 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1181/2330] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:33.894208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850e9c3-77e5-4b2a-87a2-31838228a845 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:33.903904 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850e9c3-77e5-4b2a-87a2-31838228a845 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:33.908485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c195c3-cdf5-4d5c-9c84-bbaf496f096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:33.909140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c195c3-cdf5-4d5c-9c84-bbaf496f096e admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:33.909762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c195c3-cdf5-4d5c-9c84-bbaf496f096e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:33.909762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c195c3-cdf5-4d5c-9c84-bbaf496f096e admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:33.910461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c195c3-cdf5-4d5c-9c84-bbaf496f096e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:52:33.910762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c195c3-cdf5-4d5c-9c84-bbaf496f096e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:33.912419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c195c3-cdf5-4d5c-9c84-bbaf496f096e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:33.913999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:33.925186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1150/2331] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:52:33.929506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9fa0f-04d5-4716-983d-0be7d727fd99 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:33.939521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9fa0f-04d5-4716-983d-0be7d727fd99 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:33.944341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a117ca6-14f0-4b9c-8ed7-409be68eb0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:33.944997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a117ca6-14f0-4b9c-8ed7-409be68eb0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:33.945277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a117ca6-14f0-4b9c-8ed7-409be68eb0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:33.945550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a117ca6-14f0-4b9c-8ed7-409be68eb0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:33.946242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a117ca6-14f0-4b9c-8ed7-409be68eb0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:33.948183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a117ca6-14f0-4b9c-8ed7-409be68eb0e0 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:34.035776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1182/2332] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:52:33 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:34.040234 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c195c3-cdf5-4d5c-9c84-bbaf496f096e admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:34.051217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c195c3-cdf5-4d5c-9c84-bbaf496f096e admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:34.110516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a0182-4f48-4a80-a2ce-2c773b869f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:34.111140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a0182-4f48-4a80-a2ce-2c773b869f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:34.111456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a0182-4f48-4a80-a2ce-2c773b869f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:34.111855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a0182-4f48-4a80-a2ce-2c773b869f8a admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:34.112671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a0182-4f48-4a80-a2ce-2c773b869f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:34.114673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a0182-4f48-4a80-a2ce-2c773b869f8a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:34.197833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1151/2333] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:52:34 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:34.205093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a117ca6-14f0-4b9c-8ed7-409be68eb0e0 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:34.214056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a117ca6-14f0-4b9c-8ed7-409be68eb0e0 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:34.219976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a4a8-88a7-4f38-97da-47fd9c87e69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:34.220691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a4a8-88a7-4f38-97da-47fd9c87e69b admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:34.220981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a4a8-88a7-4f38-97da-47fd9c87e69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:34.221261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a4a8-88a7-4f38-97da-47fd9c87e69b admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:34.222024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3a4a8-88a7-4f38-97da-47fd9c87e69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:34.223889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3a4a8-88a7-4f38-97da-47fd9c87e69b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:34.235825 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1183/2334] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:34.240071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a0182-4f48-4a80-a2ce-2c773b869f8a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:34.251542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a0182-4f48-4a80-a2ce-2c773b869f8a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:34.257885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d04101-5574-4ba9-bc48-6687525e6fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:34.258557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d04101-5574-4ba9-bc48-6687525e6fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:34.258838 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d04101-5574-4ba9-bc48-6687525e6fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:34.259113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d04101-5574-4ba9-bc48-6687525e6fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:34.259869 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d04101-5574-4ba9-bc48-6687525e6fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:34.261607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d04101-5574-4ba9-bc48-6687525e6fa2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:34.276077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1152/2335] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:52:34.277137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a4a8-88a7-4f38-97da-47fd9c87e69b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:34.289536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a4a8-88a7-4f38-97da-47fd9c87e69b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:34.294751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62b46e-f3db-41e5-becc-53a5414a58ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:34.295754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b46e-f3db-41e5-becc-53a5414a58ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:34.296051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b46e-f3db-41e5-becc-53a5414a58ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:34.296360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b46e-f3db-41e5-becc-53a5414a58ef admin admin] PATH_INFO: `/v3/projects/8b8475754ac444ed9a71af35fa33b33d/users/e52f60f6793c48fda27855a182d1a1f8/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:34.313751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62b46e-f3db-41e5-becc-53a5414a58ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8475754ac444ed9a71af35fa33b33d, user_id=e52f60f6793c48fda27855a182d1a1f8, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:34.316504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62b46e-f3db-41e5-becc-53a5414a58ef admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:34.382582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1184/2336] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:34 2022] PUT /identity/v3/projects/8b8475754ac444ed9a71af35fa33b33d/users/e52f60f6793c48fda27855a182d1a1f8/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:52:34.392823 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce01b3-5457-455c-9a43-68de6c8f8c55 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:34.393116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce01b3-5457-455c-9a43-68de6c8f8c55 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:34.393396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce01b3-5457-455c-9a43-68de6c8f8c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:34.421607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6bce01b3-5457-455c-9a43-68de6c8f8c55 None None] MFA Rules not processed for user `e52f60f6793c48fda27855a182d1a1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:34.423120 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6bce01b3-5457-455c-9a43-68de6c8f8c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:34.488892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1153/2337] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:34.493538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62b46e-f3db-41e5-becc-53a5414a58ef admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:34.499888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:34.553899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62b46e-f3db-41e5-becc-53a5414a58ef admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:34.558762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61de495-53e7-49f5-9192-1aa970f68752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:34.559300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de495-53e7-49f5-9192-1aa970f68752 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:34.559589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de495-53e7-49f5-9192-1aa970f68752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:34.559874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de495-53e7-49f5-9192-1aa970f68752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:34.561283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61de495-53e7-49f5-9192-1aa970f68752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:34.563353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61de495-53e7-49f5-9192-1aa970f68752 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:34.665938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1185/2338] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:52:34 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:34.667492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce01b3-5457-455c-9a43-68de6c8f8c55 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:34.688567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce01b3-5457-455c-9a43-68de6c8f8c55 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:34.782411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a691f1b-5360-45ce-987f-7ce9b755709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:34.783111 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a691f1b-5360-45ce-987f-7ce9b755709f admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:34.783400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a691f1b-5360-45ce-987f-7ce9b755709f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:34.783679 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a691f1b-5360-45ce-987f-7ce9b755709f admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:34.784555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a691f1b-5360-45ce-987f-7ce9b755709f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:34.786936 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a691f1b-5360-45ce-987f-7ce9b755709f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:34.796324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:34.931033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1154/2339] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:52:34 2022] POST /identity/v3/users => generated 296 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:34.932284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61de495-53e7-49f5-9192-1aa970f68752 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:34.944518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61de495-53e7-49f5-9192-1aa970f68752 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:34.949232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ee27-25da-42ed-99ac-1623a8a34d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:34.952261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ee27-25da-42ed-99ac-1623a8a34d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:34.952261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ee27-25da-42ed-99ac-1623a8a34d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:34.952261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ee27-25da-42ed-99ac-1623a8a34d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:34.952261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0ee27-25da-42ed-99ac-1623a8a34d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:34.953546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0ee27-25da-42ed-99ac-1623a8a34d2b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:34.970560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1186/2340] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:34.972135 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a691f1b-5360-45ce-987f-7ce9b755709f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:34.991207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a691f1b-5360-45ce-987f-7ce9b755709f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:34.996653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49230e0f-6573-4242-964c-f6695b7d55f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:34.998828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49230e0f-6573-4242-964c-f6695b7d55f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:34.999043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49230e0f-6573-4242-964c-f6695b7d55f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:34.999327 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49230e0f-6573-4242-964c-f6695b7d55f3 admin admin] PATH_INFO: `/v3/projects/1b7f8781547e450f907437bbcde03eb8/users/c9e1d2f998794f54b0b92b99c54e4db8/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:35.016752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49230e0f-6573-4242-964c-f6695b7d55f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7f8781547e450f907437bbcde03eb8, user_id=c9e1d2f998794f54b0b92b99c54e4db8, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:35.019518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49230e0f-6573-4242-964c-f6695b7d55f3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:35.104363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1155/2341] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:34 2022] PUT /identity/v3/projects/1b7f8781547e450f907437bbcde03eb8/users/c9e1d2f998794f54b0b92b99c54e4db8/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:35.111196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ee27-25da-42ed-99ac-1623a8a34d2b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:35.122240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ee27-25da-42ed-99ac-1623a8a34d2b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:35.198927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79030cb9-d021-4fff-84f5-18ee15c210d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:35.206744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79030cb9-d021-4fff-84f5-18ee15c210d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:35.206744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79030cb9-d021-4fff-84f5-18ee15c210d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:35.206744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79030cb9-d021-4fff-84f5-18ee15c210d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:35.206744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79030cb9-d021-4fff-84f5-18ee15c210d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:35.206744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79030cb9-d021-4fff-84f5-18ee15c210d4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:35.219586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1187/2342] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:35.220932 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49230e0f-6573-4242-964c-f6695b7d55f3 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:35.236790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49230e0f-6573-4242-964c-f6695b7d55f3 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:35.241991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203dbc-7cec-4326-ae78-362ffb4da8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:35.242970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203dbc-7cec-4326-ae78-362ffb4da8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:35.243329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203dbc-7cec-4326-ae78-362ffb4da8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:35.243616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203dbc-7cec-4326-ae78-362ffb4da8b0 admin admin] PATH_INFO: `/v3/projects/1b7f8781547e450f907437bbcde03eb8/users/c9e1d2f998794f54b0b92b99c54e4db8/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:35.245785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203dbc-7cec-4326-ae78-362ffb4da8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7f8781547e450f907437bbcde03eb8, user_id=c9e1d2f998794f54b0b92b99c54e4db8, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:35.249524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203dbc-7cec-4326-ae78-362ffb4da8b0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:35.262556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1156/2343] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:35 2022] PUT /identity/v3/projects/1b7f8781547e450f907437bbcde03eb8/users/c9e1d2f998794f54b0b92b99c54e4db8/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:35.276156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7f0a0-1b7a-4bf2-885f-155286035ed0 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:35.276156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7f0a0-1b7a-4bf2-885f-155286035ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:35.276156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7f0a0-1b7a-4bf2-885f-155286035ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:35.306487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7df7f0a0-1b7a-4bf2-885f-155286035ed0 None None] MFA Rules not processed for user `c9e1d2f998794f54b0b92b99c54e4db8`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:35.310846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7df7f0a0-1b7a-4bf2-885f-155286035ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:35.392269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:35.396333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1188/2344] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:35.408707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203dbc-7cec-4326-ae78-362ffb4da8b0 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:35.410370 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9f203dbc-7cec-4326-ae78-362ffb4da8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:35.471218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203dbc-7cec-4326-ae78-362ffb4da8b0 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:35.475542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefce36-5ef1-4d93-8e54-171548d59f06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:35.476277 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefce36-5ef1-4d93-8e54-171548d59f06 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:35.476663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefce36-5ef1-4d93-8e54-171548d59f06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:35.477014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefce36-5ef1-4d93-8e54-171548d59f06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:35.487958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefce36-5ef1-4d93-8e54-171548d59f06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:35.489519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefce36-5ef1-4d93-8e54-171548d59f06 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:35.500257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1157/2345] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:36.598638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7f0a0-1b7a-4bf2-885f-155286035ed0 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:36.609875 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7f0a0-1b7a-4bf2-885f-155286035ed0 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:36.615107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee3d45-a871-43ae-8412-f8c46801f625 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e1d2f998794f54b0b92b99c54e4db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b7f8781547e450f907437bbcde03eb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:36.615966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee3d45-a871-43ae-8412-f8c46801f625 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:36.616446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee3d45-a871-43ae-8412-f8c46801f625 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:36.616873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee3d45-a871-43ae-8412-f8c46801f625 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:36.617879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee3d45-a871-43ae-8412-f8c46801f625 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:52:36.618517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee3d45-a871-43ae-8412-f8c46801f625 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:36.620726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee3d45-a871-43ae-8412-f8c46801f625 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:36.636430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1189/2346] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:52:36.639671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefce36-5ef1-4d93-8e54-171548d59f06 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:36.647647 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefce36-5ef1-4d93-8e54-171548d59f06 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:36.652667 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b684ae-602c-4977-9912-f95b71c69e28 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e1d2f998794f54b0b92b99c54e4db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b7f8781547e450f907437bbcde03eb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:36.653333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b684ae-602c-4977-9912-f95b71c69e28 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:36.653623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b684ae-602c-4977-9912-f95b71c69e28 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:36.654525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b684ae-602c-4977-9912-f95b71c69e28 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:36.655252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b684ae-602c-4977-9912-f95b71c69e28 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:36.657266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b684ae-602c-4977-9912-f95b71c69e28 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:36.733934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1158/2347] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:52:36 2022] POST /identity/v3/projects => generated 354 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:36.737907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee3d45-a871-43ae-8412-f8c46801f625 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:36.750198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee3d45-a871-43ae-8412-f8c46801f625 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:36.812952 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e1d2f998794f54b0b92b99c54e4db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b7f8781547e450f907437bbcde03eb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:36.813651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:36.813938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:36.814216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:36.814977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:52:36.815287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:36.816982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:36.830994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1190/2348] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:52:36.870166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b684ae-602c-4977-9912-f95b71c69e28 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:36.881485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b684ae-602c-4977-9912-f95b71c69e28 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:36.886501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e1d2f998794f54b0b92b99c54e4db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b7f8781547e450f907437bbcde03eb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:36.887376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:36.887721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:36.888018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] PATH_INFO: `/v3/projects/e2f17e7dda9945748a90efe6303e61f2` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:36.890315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e2f17e7dda9945748a90efe6303e61f2)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:36.892249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:37.002143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f17e7dda9945748a90efe6303e61f2', 'request_id': 'req-b2a92577-8754-471d-8a3c-edc62b8ab3d4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:37.067341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f17e7dda9945748a90efe6303e61f2', 'request_id': 'req-b2a92577-8754-471d-8a3c-edc62b8ab3d4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:37.077585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f17e7dda9945748a90efe6303e61f2', 'request_id': 'req-b2a92577-8754-471d-8a3c-edc62b8ab3d4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:37.089167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] The token cache is being invalidate because project e2f17e7dda9945748a90efe6303e61f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:37.089488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:37.090197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b2a92577-8754-471d-8a3c-edc62b8ab3d4 tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:37.092461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1159/2349] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:36 2022] DELETE /identity/v3/projects/e2f17e7dda9945748a90efe6303e61f2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:52:37.609184 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:37.611061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:37.678075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87d639-20ff-4f10-8d29-3b714f489ced tempest-VolumeQuotaClassesTest-577654120 tempest-VolumeQuotaClassesTest-577654120-project-admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:37.737431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:37.738294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:37.738571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:37.738844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] PATH_INFO: `/v3/users/e52f60f6793c48fda27855a182d1a1f8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:37.740058 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52f60f6793c48fda27855a182d1a1f8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:37.742019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:37.920685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:37.934766 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52f60f6793c48fda27855a182d1a1f8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:38.022963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52f60f6793c48fda27855a182d1a1f8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:38.023176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52f60f6793c48fda27855a182d1a1f8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:38.023796 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52f60f6793c48fda27855a182d1a1f8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:38.032074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52f60f6793c48fda27855a182d1a1f8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:38.050588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1191/2350] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:52:37 2022] DELETE /identity/v3/users/e52f60f6793c48fda27855a182d1a1f8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:38.055149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c27656-c846-4c94-9373-918002c63c37 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:38.055682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c27656-c846-4c94-9373-918002c63c37 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:38.055991 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c27656-c846-4c94-9373-918002c63c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:38.073867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-90c27656-c846-4c94-9373-918002c63c37 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:38.078613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-90c27656-c846-4c94-9373-918002c63c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:38.087014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:38.135827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1160/2351] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:38.146084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:38.147534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:38.204887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ced9d-046a-4388-9ba9-38e5521f8cdc admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:38.208393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e94df5-a8fe-4fd3-9c94-cb30e2f09ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:38.209036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94df5-a8fe-4fd3-9c94-cb30e2f09ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:38.209571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94df5-a8fe-4fd3-9c94-cb30e2f09ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:38.209845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94df5-a8fe-4fd3-9c94-cb30e2f09ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:38.219124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e94df5-a8fe-4fd3-9c94-cb30e2f09ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:38.220592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e94df5-a8fe-4fd3-9c94-cb30e2f09ae0 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:38.229849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1192/2352] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:38.875763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c27656-c846-4c94-9373-918002c63c37 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:38.877408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-90c27656-c846-4c94-9373-918002c63c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:38.891141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c27656-c846-4c94-9373-918002c63c37 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:38.896029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:38.897455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:38.897927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:38.898219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] PATH_INFO: `/v3/projects/8b8475754ac444ed9a71af35fa33b33d` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:38.900134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8475754ac444ed9a71af35fa33b33d)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:38.904579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:39.012540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8475754ac444ed9a71af35fa33b33d', 'request_id': 'req-ae74d2fb-aaea-4cb0-a7be-e06aab877424'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.079380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8475754ac444ed9a71af35fa33b33d', 'request_id': 'req-ae74d2fb-aaea-4cb0-a7be-e06aab877424'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.087005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8475754ac444ed9a71af35fa33b33d', 'request_id': 'req-ae74d2fb-aaea-4cb0-a7be-e06aab877424'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.097377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] The token cache is being invalidate because project 8b8475754ac444ed9a71af35fa33b33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:39.097666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.098289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.099828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1161/2353] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:38 2022] DELETE /identity/v3/projects/8b8475754ac444ed9a71af35fa33b33d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:39.103805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e94df5-a8fe-4fd3-9c94-cb30e2f09ae0 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:39.113955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e94df5-a8fe-4fd3-9c94-cb30e2f09ae0 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:39.172797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:39.173650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:39.173933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:39.174250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] PATH_INFO: `/v3/users/c9e1d2f998794f54b0b92b99c54e4db8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:39.175525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e1d2f998794f54b0b92b99c54e4db8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:39.177628 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:39.384319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e1d2f998794f54b0b92b99c54e4db8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.387861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:39.468650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e1d2f998794f54b0b92b99c54e4db8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.469510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e1d2f998794f54b0b92b99c54e4db8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.470361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e1d2f998794f54b0b92b99c54e4db8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.477771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9cf98e8c-51cc-40e7-9c03-4a80784f362b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e1d2f998794f54b0b92b99c54e4db8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:39.494631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1193/2354] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:52:39 2022] DELETE /identity/v3/users/c9e1d2f998794f54b0b92b99c54e4db8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:39.961642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:39.970301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:39.977996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74d2fb-aaea-4cb0-a7be-e06aab877424 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:40.039493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:40.040541 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.040937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.041226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] PATH_INFO: `/v3/projects/1b7f8781547e450f907437bbcde03eb8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.042475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7f8781547e450f907437bbcde03eb8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:40.044930 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:40.167480 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:40.171119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7f8781547e450f907437bbcde03eb8', 'request_id': 'req-064918ac-4d3a-4318-8297-299a342d8fe2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:40.234011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7f8781547e450f907437bbcde03eb8', 'request_id': 'req-064918ac-4d3a-4318-8297-299a342d8fe2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:40.240825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7f8781547e450f907437bbcde03eb8', 'request_id': 'req-064918ac-4d3a-4318-8297-299a342d8fe2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:40.252515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] The token cache is being invalidate because project 1b7f8781547e450f907437bbcde03eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:40.252808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:40.253448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-064918ac-4d3a-4318-8297-299a342d8fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:40.254997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1162/2355] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:39 2022] DELETE /identity/v3/projects/1b7f8781547e450f907437bbcde03eb8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:40.259933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911afac-f211-47c1-b782-47b5245dd04c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.260451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911afac-f211-47c1-b782-47b5245dd04c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.260559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911afac-f211-47c1-b782-47b5245dd04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.279631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-1911afac-f211-47c1-b782-47b5245dd04c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:40.280906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1911afac-f211-47c1-b782-47b5245dd04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:40.344317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1194/2356] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:52:40.354594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fce373-d11d-4de0-b570-e47d5a26b375 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.355008 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fce373-d11d-4de0-b570-e47d5a26b375 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.355338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fce373-d11d-4de0-b570-e47d5a26b375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.375971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-11fce373-d11d-4de0-b570-e47d5a26b375 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:40.377330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-11fce373-d11d-4de0-b570-e47d5a26b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:40.386636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1163/2357] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:40.391221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911afac-f211-47c1-b782-47b5245dd04c None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:40.400895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911afac-f211-47c1-b782-47b5245dd04c None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:40.405593 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43d437-c414-49a1-b676-1c9d55a57b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:40.406244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43d437-c414-49a1-b676-1c9d55a57b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.407087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43d437-c414-49a1-b676-1c9d55a57b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.407087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43d437-c414-49a1-b676-1c9d55a57b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.407572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43d437-c414-49a1-b676-1c9d55a57b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:52:40.407878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43d437-c414-49a1-b676-1c9d55a57b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:40.409502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43d437-c414-49a1-b676-1c9d55a57b58 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:40.421087 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1195/2358] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:52:40.425351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fce373-d11d-4de0-b570-e47d5a26b375 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:40.434485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fce373-d11d-4de0-b570-e47d5a26b375 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:40.439793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093e19c-e2f6-4df6-b3ec-77084a3532ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:40.440487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093e19c-e2f6-4df6-b3ec-77084a3532ca admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.440761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093e19c-e2f6-4df6-b3ec-77084a3532ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.441148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093e19c-e2f6-4df6-b3ec-77084a3532ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.441922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093e19c-e2f6-4df6-b3ec-77084a3532ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:40.443859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093e19c-e2f6-4df6-b3ec-77084a3532ca admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:40.515535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1164/2359] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:52:40 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:40.519723 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43d437-c414-49a1-b676-1c9d55a57b58 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:40.530244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43d437-c414-49a1-b676-1c9d55a57b58 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:40.585225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075995a-5edb-4334-8136-c5c1e1692465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:40.585898 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075995a-5edb-4334-8136-c5c1e1692465 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.586159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075995a-5edb-4334-8136-c5c1e1692465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.586436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075995a-5edb-4334-8136-c5c1e1692465 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.587127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075995a-5edb-4334-8136-c5c1e1692465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:40.589108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075995a-5edb-4334-8136-c5c1e1692465 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:40.656377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1196/2360] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:52:40 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:40.660459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093e19c-e2f6-4df6-b3ec-77084a3532ca admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:40.671550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093e19c-e2f6-4df6-b3ec-77084a3532ca admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:40.676204 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840ed00-4265-41db-87e7-fe512ae7b7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:40.676945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840ed00-4265-41db-87e7-fe512ae7b7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.677198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840ed00-4265-41db-87e7-fe512ae7b7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.677478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840ed00-4265-41db-87e7-fe512ae7b7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.678201 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840ed00-4265-41db-87e7-fe512ae7b7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:40.679811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840ed00-4265-41db-87e7-fe512ae7b7a1 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:40.690651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1165/2361] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:40.694714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075995a-5edb-4334-8136-c5c1e1692465 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:40.705959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075995a-5edb-4334-8136-c5c1e1692465 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:40.710921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737e63d-0212-405c-8e01-283827f6d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:40.711677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737e63d-0212-405c-8e01-283827f6d505 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.711963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737e63d-0212-405c-8e01-283827f6d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.712270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737e63d-0212-405c-8e01-283827f6d505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.713040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737e63d-0212-405c-8e01-283827f6d505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:40.714651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737e63d-0212-405c-8e01-283827f6d505 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:40.725981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1197/2362] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:52:40.730123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840ed00-4265-41db-87e7-fe512ae7b7a1 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:40.740655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840ed00-4265-41db-87e7-fe512ae7b7a1 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:40.745333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba895-3bd2-41e6-85f8-7de775ec9712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:40.746377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba895-3bd2-41e6-85f8-7de775ec9712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.746666 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba895-3bd2-41e6-85f8-7de775ec9712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.746948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba895-3bd2-41e6-85f8-7de775ec9712 admin admin] PATH_INFO: `/v3/projects/f073ee0a54d74838a2d6c982a75d745b/users/45eea104e3294ffa9874f9f41cf2547d/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.762050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dba895-3bd2-41e6-85f8-7de775ec9712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f073ee0a54d74838a2d6c982a75d745b, user_id=45eea104e3294ffa9874f9f41cf2547d, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:40.768982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dba895-3bd2-41e6-85f8-7de775ec9712 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:40.863241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1166/2363] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:40 2022] PUT /identity/v3/projects/f073ee0a54d74838a2d6c982a75d745b/users/45eea104e3294ffa9874f9f41cf2547d/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:40.874198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0e176-6319-4948-a8e1-a4431b12961b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:40.874478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0e176-6319-4948-a8e1-a4431b12961b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:40.874760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0e176-6319-4948-a8e1-a4431b12961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:40.900476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-ddf0e176-6319-4948-a8e1-a4431b12961b None None] MFA Rules not processed for user `45eea104e3294ffa9874f9f41cf2547d`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:40.901686 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ddf0e176-6319-4948-a8e1-a4431b12961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:40.925291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:40.963682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1198/2364] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:40.968187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba895-3bd2-41e6-85f8-7de775ec9712 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:41.031059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba895-3bd2-41e6-85f8-7de775ec9712 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:41.035636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f158e4-7213-4189-b807-03bebe6be86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:41.036308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f158e4-7213-4189-b807-03bebe6be86c admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:41.036614 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f158e4-7213-4189-b807-03bebe6be86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:41.036891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f158e4-7213-4189-b807-03bebe6be86c admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:41.037605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f158e4-7213-4189-b807-03bebe6be86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:41.039513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f158e4-7213-4189-b807-03bebe6be86c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:41.132522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1167/2365] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:52:40 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:41.136536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0e176-6319-4948-a8e1-a4431b12961b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:41.147431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0e176-6319-4948-a8e1-a4431b12961b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:41.203126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd3b8c-dba1-4959-8b14-97ad67927d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:41.203803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd3b8c-dba1-4959-8b14-97ad67927d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:41.204089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd3b8c-dba1-4959-8b14-97ad67927d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:41.204401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd3b8c-dba1-4959-8b14-97ad67927d24 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:41.205100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd3b8c-dba1-4959-8b14-97ad67927d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:41.207332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd3b8c-dba1-4959-8b14-97ad67927d24 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:41.262555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1199/2366] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:52:41 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:41.266740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f158e4-7213-4189-b807-03bebe6be86c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:41.277402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f158e4-7213-4189-b807-03bebe6be86c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:41.282990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d5ff5-6d4a-4624-a8c5-1cfbeb52a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:41.283590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d5ff5-6d4a-4624-a8c5-1cfbeb52a5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:41.283892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d5ff5-6d4a-4624-a8c5-1cfbeb52a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:41.284185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d5ff5-6d4a-4624-a8c5-1cfbeb52a5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:41.284923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d5ff5-6d4a-4624-a8c5-1cfbeb52a5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:41.286524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d5ff5-6d4a-4624-a8c5-1cfbeb52a5b8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:41.297987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1168/2367] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:41.302035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd3b8c-dba1-4959-8b14-97ad67927d24 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:41.312221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd3b8c-dba1-4959-8b14-97ad67927d24 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:41.316778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c95a0-b415-46c3-94d2-4d48a2c8a7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:41.317648 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c95a0-b415-46c3-94d2-4d48a2c8a7df admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:41.317934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c95a0-b415-46c3-94d2-4d48a2c8a7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:41.318208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c95a0-b415-46c3-94d2-4d48a2c8a7df admin admin] PATH_INFO: `/v3/projects/87ca5ecc7b57476e9dad9499ac1feea1/users/3c1ff389d285490d967c689edbd00f52/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:41.332946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c95a0-b415-46c3-94d2-4d48a2c8a7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ca5ecc7b57476e9dad9499ac1feea1, user_id=3c1ff389d285490d967c689edbd00f52, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:41.335872 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c95a0-b415-46c3-94d2-4d48a2c8a7df admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:41.415494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1200/2368] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:41 2022] PUT /identity/v3/projects/87ca5ecc7b57476e9dad9499ac1feea1/users/3c1ff389d285490d967c689edbd00f52/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:41.419947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d5ff5-6d4a-4624-a8c5-1cfbeb52a5b8 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:41.431794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d5ff5-6d4a-4624-a8c5-1cfbeb52a5b8 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:41.476635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:41.492443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c721d-0ba8-4b42-a343-de114ea27ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:41.493123 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c721d-0ba8-4b42-a343-de114ea27ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:41.493402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c721d-0ba8-4b42-a343-de114ea27ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:41.493678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c721d-0ba8-4b42-a343-de114ea27ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:41.494429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c721d-0ba8-4b42-a343-de114ea27ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:41.496038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c721d-0ba8-4b42-a343-de114ea27ae1 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:41.505950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1169/2369] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:52:41.510222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c95a0-b415-46c3-94d2-4d48a2c8a7df admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:41.521328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c95a0-b415-46c3-94d2-4d48a2c8a7df admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:41.526066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfce85a-0cde-4bd8-990c-ebe5a65860ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:41.526959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce85a-0cde-4bd8-990c-ebe5a65860ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:41.533624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce85a-0cde-4bd8-990c-ebe5a65860ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:41.533624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce85a-0cde-4bd8-990c-ebe5a65860ad admin admin] PATH_INFO: `/v3/projects/87ca5ecc7b57476e9dad9499ac1feea1/users/3c1ff389d285490d967c689edbd00f52/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:41.533624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfce85a-0cde-4bd8-990c-ebe5a65860ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ca5ecc7b57476e9dad9499ac1feea1, user_id=3c1ff389d285490d967c689edbd00f52, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:41.533624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfce85a-0cde-4bd8-990c-ebe5a65860ad admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:41.544132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1201/2370] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:41 2022] PUT /identity/v3/projects/87ca5ecc7b57476e9dad9499ac1feea1/users/3c1ff389d285490d967c689edbd00f52/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:52:41.556996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed99a-aa41-423a-9922-3a6f644b105b None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:41.557290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed99a-aa41-423a-9922-3a6f644b105b None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:41.557574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed99a-aa41-423a-9922-3a6f644b105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:41.586166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1a0ed99a-aa41-423a-9922-3a6f644b105b None None] MFA Rules not processed for user `3c1ff389d285490d967c689edbd00f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:41.587386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1a0ed99a-aa41-423a-9922-3a6f644b105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:41.658825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1170/2371] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:41.670051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfce85a-0cde-4bd8-990c-ebe5a65860ad admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:41.671771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5dfce85a-0cde-4bd8-990c-ebe5a65860ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:41.730390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfce85a-0cde-4bd8-990c-ebe5a65860ad admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:41.735050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84337e8c-fde2-4166-9a4c-5a09ffd6252a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:41.735695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84337e8c-fde2-4166-9a4c-5a09ffd6252a service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:41.735986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84337e8c-fde2-4166-9a4c-5a09ffd6252a service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:41.736269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84337e8c-fde2-4166-9a4c-5a09ffd6252a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:41.745163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84337e8c-fde2-4166-9a4c-5a09ffd6252a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:41.746605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84337e8c-fde2-4166-9a4c-5a09ffd6252a service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:41.757158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1202/2372] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:42.875306 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ed99a-aa41-423a-9922-3a6f644b105b None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:42.940828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ed99a-aa41-423a-9922-3a6f644b105b None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:42.945488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:42.946441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:42.946729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:42.947045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] PATH_INFO: `/v3/users/45eea104e3294ffa9874f9f41cf2547d` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:42.948338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45eea104e3294ffa9874f9f41cf2547d)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:42.950350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:43.107714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45eea104e3294ffa9874f9f41cf2547d'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:43.108366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45eea104e3294ffa9874f9f41cf2547d'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:43.117206 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45eea104e3294ffa9874f9f41cf2547d'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:43.125537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:43.130956 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45eea104e3294ffa9874f9f41cf2547d'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:43.228161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45eea104e3294ffa9874f9f41cf2547d'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:43.234826 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1171/2373] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:52:42 2022] DELETE /identity/v3/users/45eea104e3294ffa9874f9f41cf2547d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:43.239436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69f164-f601-40c7-997a-7b1b4074e9bc None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:43.240015 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69f164-f601-40c7-997a-7b1b4074e9bc None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:43.240116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69f164-f601-40c7-997a-7b1b4074e9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:43.259681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2b69f164-f601-40c7-997a-7b1b4074e9bc None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:43.261010 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2b69f164-f601-40c7-997a-7b1b4074e9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:43.283162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:43.329002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1203/2374] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:43.338120 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:43.339661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:43.409566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7649b-de80-4621-a979-3a68ec84dea4 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:43.413510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7d5d2-0f18-4e85-9360-baa508c3ae8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:43.414158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d5d2-0f18-4e85-9360-baa508c3ae8b service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:43.414442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d5d2-0f18-4e85-9360-baa508c3ae8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:43.414726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d5d2-0f18-4e85-9360-baa508c3ae8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:43.423849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7d5d2-0f18-4e85-9360-baa508c3ae8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:43.425436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7d5d2-0f18-4e85-9360-baa508c3ae8b service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:43.436583 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1172/2375] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:43.926357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69f164-f601-40c7-997a-7b1b4074e9bc None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:43.927824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2b69f164-f601-40c7-997a-7b1b4074e9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:43.939882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69f164-f601-40c7-997a-7b1b4074e9bc None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:43.944630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:43.945664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:43.945769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:43.946041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] PATH_INFO: `/v3/projects/f073ee0a54d74838a2d6c982a75d745b` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:43.947321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f073ee0a54d74838a2d6c982a75d745b)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:43.949303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:44.063428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f073ee0a54d74838a2d6c982a75d745b', 'request_id': 'req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.068988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f073ee0a54d74838a2d6c982a75d745b', 'request_id': 'req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.165154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f073ee0a54d74838a2d6c982a75d745b', 'request_id': 'req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.177493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] The token cache is being invalidate because project f073ee0a54d74838a2d6c982a75d745b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:44.177813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.178457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.180218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1204/2376] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:43 2022] DELETE /identity/v3/projects/f073ee0a54d74838a2d6c982a75d745b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:44.184028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7d5d2-0f18-4e85-9360-baa508c3ae8b service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:44.194777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7d5d2-0f18-4e85-9360-baa508c3ae8b service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:44.255060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:44.255937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:44.256222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:44.256533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] PATH_INFO: `/v3/users/3c1ff389d285490d967c689edbd00f52` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:44.257724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1ff389d285490d967c689edbd00f52)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:44.259657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:44.454309 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1ff389d285490d967c689edbd00f52'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.454908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1ff389d285490d967c689edbd00f52'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.462031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1ff389d285490d967c689edbd00f52'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.474872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1ff389d285490d967c689edbd00f52'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.559613 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-bed68526-e565-4db6-a58e-0d72548bc7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1ff389d285490d967c689edbd00f52'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:44.566822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1173/2377] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:52:44 2022] DELETE /identity/v3/users/3c1ff389d285490d967c689edbd00f52 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:52:44.955100 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:44.956143 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:44.970486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9c2b6-78ba-436c-ab2d-cfe9a4d30a87 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:45.028458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:45.030012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.030298 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.030580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] PATH_INFO: `/v3/projects/87ca5ecc7b57476e9dad9499ac1feea1` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.031758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ca5ecc7b57476e9dad9499ac1feea1)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:45.033832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:45.078748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949670-214f-4437-8a14-3afb6eb336dd None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.083014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949670-214f-4437-8a14-3afb6eb336dd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.083014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949670-214f-4437-8a14-3afb6eb336dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.086688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:45.098150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b5949670-214f-4437-8a14-3afb6eb336dd None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:45.099330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b5949670-214f-4437-8a14-3afb6eb336dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:45.156154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1174/2378] 10.222.0.74 () {58 vars in 967 bytes} [Mon May 23 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:45.181764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:45.184999 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ca5ecc7b57476e9dad9499ac1feea1', 'request_id': 'req-ca86c008-77fe-424c-9d37-c89805c0e57d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:45.190612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ca5ecc7b57476e9dad9499ac1feea1', 'request_id': 'req-ca86c008-77fe-424c-9d37-c89805c0e57d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:45.296997 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ca5ecc7b57476e9dad9499ac1feea1', 'request_id': 'req-ca86c008-77fe-424c-9d37-c89805c0e57d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:45.308890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] The token cache is being invalidate because project 87ca5ecc7b57476e9dad9499ac1feea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:45.309183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:45.309804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:45.312738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1205/2379] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:44 2022] DELETE /identity/v3/projects/87ca5ecc7b57476e9dad9499ac1feea1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:45.317624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8fda1-2b6e-4e7d-a74e-d13b4b7772ab None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.318035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8fda1-2b6e-4e7d-a74e-d13b4b7772ab None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.318186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8fda1-2b6e-4e7d-a74e-d13b4b7772ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.324569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:45.326111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:45.337368 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-13d8fda1-2b6e-4e7d-a74e-d13b4b7772ab None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:45.338569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-13d8fda1-2b6e-4e7d-a74e-d13b4b7772ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:45.397538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c008-77fe-424c-9d37-c89805c0e57d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:45.401200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1175/2380] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:45.405937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c4343-0473-4d1c-833f-bd5e052f2143 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:45.406585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c4343-0473-4d1c-833f-bd5e052f2143 service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.406866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c4343-0473-4d1c-833f-bd5e052f2143 service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.407140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c4343-0473-4d1c-833f-bd5e052f2143 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.408944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70bef7-9779-4274-bd66-24b81818fcd5 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.409077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6f9c4343-0473-4d1c-833f-bd5e052f2143 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:45.409261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70bef7-9779-4274-bd66-24b81818fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.409550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70bef7-9779-4274-bd66-24b81818fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.428857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1d70bef7-9779-4274-bd66-24b81818fcd5 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:45.430067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1d70bef7-9779-4274-bd66-24b81818fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:45.439122 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1176/2381] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:52:45.442880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70bef7-9779-4274-bd66-24b81818fcd5 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:45.452737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70bef7-9779-4274-bd66-24b81818fcd5 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:45.457515 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028c248-884d-4048-818f-0b54fdc96f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:45.458217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028c248-884d-4048-818f-0b54fdc96f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.458501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028c248-884d-4048-818f-0b54fdc96f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.458778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028c248-884d-4048-818f-0b54fdc96f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.459817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028c248-884d-4048-818f-0b54fdc96f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:52:45.460122 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028c248-884d-4048-818f-0b54fdc96f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:45.461811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028c248-884d-4048-818f-0b54fdc96f9d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:45.474574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1177/2382] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:52:45.475041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c4343-0473-4d1c-833f-bd5e052f2143 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:45.476677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c4343-0473-4d1c-833f-bd5e052f2143 service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:45.479021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028c248-884d-4048-818f-0b54fdc96f9d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:45.486485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1206/2383] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:52:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:52:45.489483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028c248-884d-4048-818f-0b54fdc96f9d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:45.494581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68c841-130a-4cb4-9bdd-c52959eacd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:45.495434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68c841-130a-4cb4-9bdd-c52959eacd74 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.495727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68c841-130a-4cb4-9bdd-c52959eacd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.496010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68c841-130a-4cb4-9bdd-c52959eacd74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.497193 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68c841-130a-4cb4-9bdd-c52959eacd74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:45.499450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68c841-130a-4cb4-9bdd-c52959eacd74 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:45.578541 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1178/2384] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:52:45 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:45.582466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c4343-0473-4d1c-833f-bd5e052f2143 service swift] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:45.593860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c4343-0473-4d1c-833f-bd5e052f2143 service swift] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:45.651914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec97ba6-3924-462f-8123-fcc1c1864cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:45.652619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97ba6-3924-462f-8123-fcc1c1864cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.652929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97ba6-3924-462f-8123-fcc1c1864cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.653204 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97ba6-3924-462f-8123-fcc1c1864cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.653918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec97ba6-3924-462f-8123-fcc1c1864cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:45.655845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec97ba6-3924-462f-8123-fcc1c1864cd6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:45.749792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1207/2385] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:52:45 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:45.754036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68c841-130a-4cb4-9bdd-c52959eacd74 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:45.765452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68c841-130a-4cb4-9bdd-c52959eacd74 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:45.770393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a07da-2a69-4fea-ab2e-4f4c1a855fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:45.771050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a07da-2a69-4fea-ab2e-4f4c1a855fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.771334 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a07da-2a69-4fea-ab2e-4f4c1a855fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.771611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a07da-2a69-4fea-ab2e-4f4c1a855fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.772356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a07da-2a69-4fea-ab2e-4f4c1a855fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:45.773968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a07da-2a69-4fea-ab2e-4f4c1a855fd3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:45.784286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1179/2386] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:45.788286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec97ba6-3924-462f-8123-fcc1c1864cd6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:45.795315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:45.799583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec97ba6-3924-462f-8123-fcc1c1864cd6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:45.805086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1fc9e-f1ac-4f25-970c-2ee9fd84a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:45.805774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1fc9e-f1ac-4f25-970c-2ee9fd84a343 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.806731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1fc9e-f1ac-4f25-970c-2ee9fd84a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.806731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1fc9e-f1ac-4f25-970c-2ee9fd84a343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.807090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1fc9e-f1ac-4f25-970c-2ee9fd84a343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:45.808755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1fc9e-f1ac-4f25-970c-2ee9fd84a343 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:45.822348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1208/2387] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:45.823806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a07da-2a69-4fea-ab2e-4f4c1a855fd3 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:45.834880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a07da-2a69-4fea-ab2e-4f4c1a855fd3 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:45.839477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f57063-6f9a-45f2-8a9b-83dc466e87f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:45.840386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f57063-6f9a-45f2-8a9b-83dc466e87f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.840771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f57063-6f9a-45f2-8a9b-83dc466e87f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.841054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f57063-6f9a-45f2-8a9b-83dc466e87f6 admin admin] PATH_INFO: `/v3/projects/5e841b0446c24ed8ad27b1d4fe85234f/users/33a7f1c8ac944b9bbb812d357374ec31/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.856629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f57063-6f9a-45f2-8a9b-83dc466e87f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e841b0446c24ed8ad27b1d4fe85234f, user_id=33a7f1c8ac944b9bbb812d357374ec31, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:45.860177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f57063-6f9a-45f2-8a9b-83dc466e87f6 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:45.938305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1180/2388] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:45 2022] PUT /identity/v3/projects/5e841b0446c24ed8ad27b1d4fe85234f/users/33a7f1c8ac944b9bbb812d357374ec31/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:45.949432 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb38615-8c81-43fa-8e58-727a5538121e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:45.949731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb38615-8c81-43fa-8e58-727a5538121e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:45.950012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb38615-8c81-43fa-8e58-727a5538121e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:45.976255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-deb38615-8c81-43fa-8e58-727a5538121e None None] MFA Rules not processed for user `33a7f1c8ac944b9bbb812d357374ec31`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:45.977567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-deb38615-8c81-43fa-8e58-727a5538121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:46.047935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1209/2389] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:46.052453 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f57063-6f9a-45f2-8a9b-83dc466e87f6 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:46.088807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:46.116093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f57063-6f9a-45f2-8a9b-83dc466e87f6 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:46.120788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c0eb6-df74-427f-9085-67f6cb7bd4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:46.121444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c0eb6-df74-427f-9085-67f6cb7bd4de admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:46.121736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c0eb6-df74-427f-9085-67f6cb7bd4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:46.122016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c0eb6-df74-427f-9085-67f6cb7bd4de admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:46.123337 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c0eb6-df74-427f-9085-67f6cb7bd4de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:46.125380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c0eb6-df74-427f-9085-67f6cb7bd4de admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:46.215822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1181/2390] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:52:46 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:46.217336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb38615-8c81-43fa-8e58-727a5538121e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:46.228361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb38615-8c81-43fa-8e58-727a5538121e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:46.286685 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86866eb0-aabc-487c-927e-92df1dec1cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:46.287431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86866eb0-aabc-487c-927e-92df1dec1cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:46.287717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86866eb0-aabc-487c-927e-92df1dec1cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:46.288015 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86866eb0-aabc-487c-927e-92df1dec1cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:46.288726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86866eb0-aabc-487c-927e-92df1dec1cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:46.290704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86866eb0-aabc-487c-927e-92df1dec1cf9 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:46.377896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1210/2391] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:52:46 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:46.381773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c0eb6-df74-427f-9085-67f6cb7bd4de admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:46.392771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c0eb6-df74-427f-9085-67f6cb7bd4de admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:46.397589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa9112-26a2-4a23-a6ff-d41a94c6371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:46.398249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa9112-26a2-4a23-a6ff-d41a94c6371b admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:46.398535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa9112-26a2-4a23-a6ff-d41a94c6371b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:46.398815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa9112-26a2-4a23-a6ff-d41a94c6371b admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:46.399651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa9112-26a2-4a23-a6ff-d41a94c6371b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:46.401376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa9112-26a2-4a23-a6ff-d41a94c6371b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:46.413824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1182/2392] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:46.417838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86866eb0-aabc-487c-927e-92df1dec1cf9 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:46.429578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86866eb0-aabc-487c-927e-92df1dec1cf9 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:46.434785 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e286aee-a23b-4f89-8291-070fd980a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:46.436007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e286aee-a23b-4f89-8291-070fd980a9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:46.436312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e286aee-a23b-4f89-8291-070fd980a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:46.436604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e286aee-a23b-4f89-8291-070fd980a9fd admin admin] PATH_INFO: `/v3/projects/398548fa9757443db04491d06f0f473b/users/00a8265e2080444e85d52196f0f83a9f/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:46.456643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e286aee-a23b-4f89-8291-070fd980a9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=398548fa9757443db04491d06f0f473b, user_id=00a8265e2080444e85d52196f0f83a9f, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:46.459909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e286aee-a23b-4f89-8291-070fd980a9fd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:46.543380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1211/2393] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:46 2022] PUT /identity/v3/projects/398548fa9757443db04491d06f0f473b/users/00a8265e2080444e85d52196f0f83a9f/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:46.548555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa9112-26a2-4a23-a6ff-d41a94c6371b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:46.558737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa9112-26a2-4a23-a6ff-d41a94c6371b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:46.617522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ff524-03ed-41d0-8ff2-a528c843f081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:46.618342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ff524-03ed-41d0-8ff2-a528c843f081 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:46.618622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ff524-03ed-41d0-8ff2-a528c843f081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:46.618896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ff524-03ed-41d0-8ff2-a528c843f081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:46.619761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ff524-03ed-41d0-8ff2-a528c843f081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:46.621393 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ff524-03ed-41d0-8ff2-a528c843f081 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:46.635002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1183/2394] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:46.635704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e286aee-a23b-4f89-8291-070fd980a9fd admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:46.646521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e286aee-a23b-4f89-8291-070fd980a9fd admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:46.651114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d4e0-bbbe-4fa0-81e1-76c9d4e5835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:46.652006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d4e0-bbbe-4fa0-81e1-76c9d4e5835c admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:46.652283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d4e0-bbbe-4fa0-81e1-76c9d4e5835c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:46.652581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d4e0-bbbe-4fa0-81e1-76c9d4e5835c admin admin] PATH_INFO: `/v3/projects/398548fa9757443db04491d06f0f473b/users/00a8265e2080444e85d52196f0f83a9f/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:46.654854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d4e0-bbbe-4fa0-81e1-76c9d4e5835c admin admin] RBAC: Authorizing `identity:create_grant(project_id=398548fa9757443db04491d06f0f473b, user_id=00a8265e2080444e85d52196f0f83a9f, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:46.657541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d4e0-bbbe-4fa0-81e1-76c9d4e5835c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:46.667931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1212/2395] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:46 2022] PUT /identity/v3/projects/398548fa9757443db04491d06f0f473b/users/00a8265e2080444e85d52196f0f83a9f/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:52:46.679553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0625545-89fc-4175-840e-82b4fb88fdfb None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:46.679835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0625545-89fc-4175-840e-82b4fb88fdfb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:46.680122 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0625545-89fc-4175-840e-82b4fb88fdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:46.708085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d0625545-89fc-4175-840e-82b4fb88fdfb None None] MFA Rules not processed for user `00a8265e2080444e85d52196f0f83a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:46.709638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d0625545-89fc-4175-840e-82b4fb88fdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:46.781663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1184/2396] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:46.793869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d4e0-bbbe-4fa0-81e1-76c9d4e5835c admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:46.795863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f904d4e0-bbbe-4fa0-81e1-76c9d4e5835c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:46.837170 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:46.854518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d4e0-bbbe-4fa0-81e1-76c9d4e5835c admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:46.859281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ad46e-12ea-4c95-bb04-9f2c22b48c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:46.859938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ad46e-12ea-4c95-bb04-9f2c22b48c5e service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:46.860225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ad46e-12ea-4c95-bb04-9f2c22b48c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:46.860535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ad46e-12ea-4c95-bb04-9f2c22b48c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:46.870129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ad46e-12ea-4c95-bb04-9f2c22b48c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:46.871573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ad46e-12ea-4c95-bb04-9f2c22b48c5e service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:46.882096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1213/2397] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:47.417547 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0625545-89fc-4175-840e-82b4fb88fdfb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:47.460990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:47.499639 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0625545-89fc-4175-840e-82b4fb88fdfb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:47.505448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:47.506406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:47.506708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:47.506984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] PATH_INFO: `/v3/users/33a7f1c8ac944b9bbb812d357374ec31` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:47.508343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a7f1c8ac944b9bbb812d357374ec31)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:47.510945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:47.692822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a7f1c8ac944b9bbb812d357374ec31'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:47.693384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a7f1c8ac944b9bbb812d357374ec31'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:47.700410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a7f1c8ac944b9bbb812d357374ec31'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:47.712330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a7f1c8ac944b9bbb812d357374ec31'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:47.805798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a7f1c8ac944b9bbb812d357374ec31'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:47.812745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1185/2398] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:52:47 2022] DELETE /identity/v3/users/33a7f1c8ac944b9bbb812d357374ec31 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:47.818192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c998dd6-9e80-469e-860e-3c0eac86e276 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:47.818192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c998dd6-9e80-469e-860e-3c0eac86e276 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:47.818192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c998dd6-9e80-469e-860e-3c0eac86e276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:47.836173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2c998dd6-9e80-469e-860e-3c0eac86e276 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:47.837431 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2c998dd6-9e80-469e-860e-3c0eac86e276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:47.899130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1214/2399] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:47.911610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:47.913144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:47.984141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309af0a-565f-41f6-b7e1-f4fe30b10c70 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:47.989285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428aaf0-3e12-46d6-9b9d-f0fbdaa141e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:47.989772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428aaf0-3e12-46d6-9b9d-f0fbdaa141e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:47.990374 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428aaf0-3e12-46d6-9b9d-f0fbdaa141e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:47.990782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428aaf0-3e12-46d6-9b9d-f0fbdaa141e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:48.003156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428aaf0-3e12-46d6-9b9d-f0fbdaa141e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:48.005314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428aaf0-3e12-46d6-9b9d-f0fbdaa141e8 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:48.018054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1186/2400] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:48.465217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c998dd6-9e80-469e-860e-3c0eac86e276 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:48.467633 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2c998dd6-9e80-469e-860e-3c0eac86e276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:48.489361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c998dd6-9e80-469e-860e-3c0eac86e276 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:48.496958 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:48.503272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:48.503272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:48.503272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] PATH_INFO: `/v3/projects/5e841b0446c24ed8ad27b1d4fe85234f` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:48.503272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e841b0446c24ed8ad27b1d4fe85234f)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:48.503272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:48.605365 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e841b0446c24ed8ad27b1d4fe85234f', 'request_id': 'req-e76329e9-4020-444b-baf6-9f6f6c3ef914'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:48.610929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e841b0446c24ed8ad27b1d4fe85234f', 'request_id': 'req-e76329e9-4020-444b-baf6-9f6f6c3ef914'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:48.691171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e841b0446c24ed8ad27b1d4fe85234f', 'request_id': 'req-e76329e9-4020-444b-baf6-9f6f6c3ef914'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:48.704033 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] The token cache is being invalidate because project 5e841b0446c24ed8ad27b1d4fe85234f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:48.704358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:48.705010 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:48.706835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1215/2401] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:48 2022] DELETE /identity/v3/projects/5e841b0446c24ed8ad27b1d4fe85234f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:48.710834 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428aaf0-3e12-46d6-9b9d-f0fbdaa141e8 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:48.721918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428aaf0-3e12-46d6-9b9d-f0fbdaa141e8 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:48.781051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:48.791429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:48.792712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:48.793303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:48.793303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] PATH_INFO: `/v3/users/00a8265e2080444e85d52196f0f83a9f` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:48.794535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a8265e2080444e85d52196f0f83a9f)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:48.796564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:48.984911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a8265e2080444e85d52196f0f83a9f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:48.985698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a8265e2080444e85d52196f0f83a9f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:48.993063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a8265e2080444e85d52196f0f83a9f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:49.006333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a8265e2080444e85d52196f0f83a9f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:49.051309 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b90f81b2-9d0e-4a35-b52a-7e8e87ee02a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a8265e2080444e85d52196f0f83a9f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:49.057968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1187/2402] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:52:48 2022] DELETE /identity/v3/users/00a8265e2080444e85d52196f0f83a9f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:52:49.487674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:49.489399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:49.518836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76329e9-4020-444b-baf6-9f6f6c3ef914 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:49.597859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:49.598775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:49.599257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:49.599678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] PATH_INFO: `/v3/projects/398548fa9757443db04491d06f0f473b` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:49.601063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398548fa9757443db04491d06f0f473b)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:49.603895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:49.607865 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:49.719733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398548fa9757443db04491d06f0f473b', 'request_id': 'req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:49.725137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398548fa9757443db04491d06f0f473b', 'request_id': 'req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:49.850947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398548fa9757443db04491d06f0f473b', 'request_id': 'req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:49.863645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] The token cache is being invalidate because project 398548fa9757443db04491d06f0f473b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:49.863933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:49.866829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:49.866829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1216/2403] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:49 2022] DELETE /identity/v3/projects/398548fa9757443db04491d06f0f473b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:49.871138 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751ae03-0f7d-4838-90ab-09954ec91bc0 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:49.871614 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751ae03-0f7d-4838-90ab-09954ec91bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:49.871708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751ae03-0f7d-4838-90ab-09954ec91bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:49.890850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0751ae03-0f7d-4838-90ab-09954ec91bc0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:49.892059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0751ae03-0f7d-4838-90ab-09954ec91bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:49.915866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:49.917295 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:49.974301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1188/2404] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:49.983471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5a50-a4e9-4688-96af-51fa95930622 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:49.983764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5a50-a4e9-4688-96af-51fa95930622 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:49.984046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5a50-a4e9-4688-96af-51fa95930622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:49.991812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba436bc-9387-4dc6-a04c-d50b13a0bbc1 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:49.997042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa09f8b-d3b0-438f-8cea-d01d8592ee84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:49.998889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa09f8b-d3b0-438f-8cea-d01d8592ee84 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:49.998889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa09f8b-d3b0-438f-8cea-d01d8592ee84 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:49.998889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa09f8b-d3b0-438f-8cea-d01d8592ee84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:50.000543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-faa09f8b-d3b0-438f-8cea-d01d8592ee84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:50.003031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-192e5a50-a4e9-4688-96af-51fa95930622 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:50.004266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-192e5a50-a4e9-4688-96af-51fa95930622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:50.011988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa09f8b-d3b0-438f-8cea-d01d8592ee84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:50.012241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1189/2405] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:52:50.014032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa09f8b-d3b0-438f-8cea-d01d8592ee84 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:50.017514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e5a50-a4e9-4688-96af-51fa95930622 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:50.030145 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1217/2406] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:52:50.030279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e5a50-a4e9-4688-96af-51fa95930622 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:50.035703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeee27-c926-467d-852a-fe0e7372883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:50.036676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeee27-c926-467d-852a-fe0e7372883a admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:50.037154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeee27-c926-467d-852a-fe0e7372883a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:50.037777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeee27-c926-467d-852a-fe0e7372883a admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:50.039087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeee27-c926-467d-852a-fe0e7372883a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:52:50.039501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeee27-c926-467d-852a-fe0e7372883a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:50.041635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeee27-c926-467d-852a-fe0e7372883a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:50.061159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1190/2407] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:52:50.071546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa09f8b-d3b0-438f-8cea-d01d8592ee84 service placement] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:50.082244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa09f8b-d3b0-438f-8cea-d01d8592ee84 service placement] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:50.087329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc70ef-958e-4726-84ce-ccda71a4e3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:50.087960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc70ef-958e-4726-84ce-ccda71a4e3cd admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:50.088241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc70ef-958e-4726-84ce-ccda71a4e3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:50.088548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc70ef-958e-4726-84ce-ccda71a4e3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:50.089234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc70ef-958e-4726-84ce-ccda71a4e3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:50.091666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc70ef-958e-4726-84ce-ccda71a4e3cd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:50.180977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1218/2408] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:52:50 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:50.182398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeee27-c926-467d-852a-fe0e7372883a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:50.195501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeee27-c926-467d-852a-fe0e7372883a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:50.244457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:50.254402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66977f-47df-4115-afc9-b60bb681e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:50.255085 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66977f-47df-4115-afc9-b60bb681e621 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:50.255377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66977f-47df-4115-afc9-b60bb681e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:50.255714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66977f-47df-4115-afc9-b60bb681e621 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:50.259761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66977f-47df-4115-afc9-b60bb681e621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:50.259761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66977f-47df-4115-afc9-b60bb681e621 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:50.336934 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1191/2409] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:52:50 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:52:50.338367 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc70ef-958e-4726-84ce-ccda71a4e3cd admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:50.351749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc70ef-958e-4726-84ce-ccda71a4e3cd admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:50.358277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce090cc-b745-4cb7-a684-c9b8b4942c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:50.359099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce090cc-b745-4cb7-a684-c9b8b4942c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:50.359514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce090cc-b745-4cb7-a684-c9b8b4942c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:50.359892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce090cc-b745-4cb7-a684-c9b8b4942c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:50.360767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce090cc-b745-4cb7-a684-c9b8b4942c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:50.362527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce090cc-b745-4cb7-a684-c9b8b4942c79 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:50.375598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1219/2410] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:52:50.379494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66977f-47df-4115-afc9-b60bb681e621 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:50.390015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66977f-47df-4115-afc9-b60bb681e621 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:50.395002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0dfe3-0840-44a6-8e2a-e9fd58d2dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:50.395673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0dfe3-0840-44a6-8e2a-e9fd58d2dfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:50.395954 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0dfe3-0840-44a6-8e2a-e9fd58d2dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:50.396221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0dfe3-0840-44a6-8e2a-e9fd58d2dfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:50.396996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0dfe3-0840-44a6-8e2a-e9fd58d2dfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:50.398910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0dfe3-0840-44a6-8e2a-e9fd58d2dfb0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:50.410439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1192/2411] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:52:50.414291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce090cc-b745-4cb7-a684-c9b8b4942c79 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:50.426784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce090cc-b745-4cb7-a684-c9b8b4942c79 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:50.432700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923b1f-3669-4da7-a672-4aa58c7e1bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:50.433518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923b1f-3669-4da7-a672-4aa58c7e1bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:50.433746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923b1f-3669-4da7-a672-4aa58c7e1bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:50.434499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923b1f-3669-4da7-a672-4aa58c7e1bfc admin admin] PATH_INFO: `/v3/projects/d29859ebe83140c3803f16b7d42de02a/users/c3a77f8699f54a84a6cbb1e25501b33a/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:50.451503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923b1f-3669-4da7-a672-4aa58c7e1bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29859ebe83140c3803f16b7d42de02a, user_id=c3a77f8699f54a84a6cbb1e25501b33a, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:50.454237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923b1f-3669-4da7-a672-4aa58c7e1bfc admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:50.537586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1220/2412] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:52:50 2022] PUT /identity/v3/projects/d29859ebe83140c3803f16b7d42de02a/users/c3a77f8699f54a84a6cbb1e25501b33a/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:50.549742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e71d1-4c0c-40b5-a962-9a813795062a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:50.550106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e71d1-4c0c-40b5-a962-9a813795062a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:50.550452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e71d1-4c0c-40b5-a962-9a813795062a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:50.580116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-410e71d1-4c0c-40b5-a962-9a813795062a None None] MFA Rules not processed for user `c3a77f8699f54a84a6cbb1e25501b33a`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:52:50.581331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-410e71d1-4c0c-40b5-a962-9a813795062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:50.648936 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1193/2413] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:52:50.659624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923b1f-3669-4da7-a672-4aa58c7e1bfc admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:50.661435 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-80923b1f-3669-4da7-a672-4aa58c7e1bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:50.690877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:50.723826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923b1f-3669-4da7-a672-4aa58c7e1bfc admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:50.727507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1548e01-44d8-489c-84c0-a6552484a017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:50.728164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1548e01-44d8-489c-84c0-a6552484a017 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:50.728496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1548e01-44d8-489c-84c0-a6552484a017 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:50.728807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1548e01-44d8-489c-84c0-a6552484a017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:50.737856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1548e01-44d8-489c-84c0-a6552484a017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:50.739303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1548e01-44d8-489c-84c0-a6552484a017 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:50.748802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1221/2414] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:52:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:52:53.875007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e71d1-4c0c-40b5-a962-9a813795062a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:53.877321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-410e71d1-4c0c-40b5-a962-9a813795062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:53.947901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e71d1-4c0c-40b5-a962-9a813795062a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:53.952585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:53.953463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:53.953748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:53.954026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] PATH_INFO: `/v3/users/3d8a088405d549cda80615fd41a661c0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:53.955216 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8a088405d549cda80615fd41a661c0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:53.957180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:54.173477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8a088405d549cda80615fd41a661c0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.174084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8a088405d549cda80615fd41a661c0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.180894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8a088405d549cda80615fd41a661c0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.186226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:54.193987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8a088405d549cda80615fd41a661c0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.308483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8a088405d549cda80615fd41a661c0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.314964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1194/2415] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:52:53 2022] DELETE /identity/v3/users/3d8a088405d549cda80615fd41a661c0 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:54.567941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1548e01-44d8-489c-84c0-a6552484a017 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:54.581504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1548e01-44d8-489c-84c0-a6552484a017 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:54.657018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:54.657908 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:54.658188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:54.658461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] PATH_INFO: `/v3/projects/74aa5dda63754f62b71d74fcaa4bee01` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:54.659677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74aa5dda63754f62b71d74fcaa4bee01)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:54.661652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:54.765089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74aa5dda63754f62b71d74fcaa4bee01', 'request_id': 'req-e4e782b5-b905-4942-adbc-bed135460831'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.772189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74aa5dda63754f62b71d74fcaa4bee01', 'request_id': 'req-e4e782b5-b905-4942-adbc-bed135460831'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.832841 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74aa5dda63754f62b71d74fcaa4bee01', 'request_id': 'req-e4e782b5-b905-4942-adbc-bed135460831'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.845266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] The token cache is being invalidate because project 74aa5dda63754f62b71d74fcaa4bee01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:54.845558 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.846178 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:54.853782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1222/2416] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:54 2022] DELETE /identity/v3/projects/74aa5dda63754f62b71d74fcaa4bee01 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:54.853927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:54.853927 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:54.866788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1ef54-faaa-4e64-8f38-b1e2def6acd8 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:54.923831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:54.924733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:54.925014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:54.925291 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] PATH_INFO: `/v3/users/d68bf02177f24e2498ee003198dbdec1` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:54.926468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68bf02177f24e2498ee003198dbdec1)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:54.928442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:55.132278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68bf02177f24e2498ee003198dbdec1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.132871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68bf02177f24e2498ee003198dbdec1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.140810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68bf02177f24e2498ee003198dbdec1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.152403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68bf02177f24e2498ee003198dbdec1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.222399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68bf02177f24e2498ee003198dbdec1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.228937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1195/2417] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:52:54 2022] DELETE /identity/v3/users/d68bf02177f24e2498ee003198dbdec1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:52:55.481242 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:52:55.483506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:52:55.496251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e782b5-b905-4942-adbc-bed135460831 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:52:55.547989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:55.553835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:52:55.561994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:52:55.561994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:52:55.561994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] PATH_INFO: `/v3/projects/cc71d5461ddf415d930a918d49285599` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:52:55.561994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc71d5461ddf415d930a918d49285599)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:52:55.561994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:52:55.668780 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc71d5461ddf415d930a918d49285599', 'request_id': 'req-d72d2c93-e715-4234-a33a-6aa67393052c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.674354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc71d5461ddf415d930a918d49285599', 'request_id': 'req-d72d2c93-e715-4234-a33a-6aa67393052c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.753829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc71d5461ddf415d930a918d49285599', 'request_id': 'req-d72d2c93-e715-4234-a33a-6aa67393052c'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.765973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] The token cache is being invalidate because project cc71d5461ddf415d930a918d49285599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:52:55.768237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.768237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d72d2c93-e715-4234-a33a-6aa67393052c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:52:55.768755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1223/2418] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:52:55 2022] DELETE /identity/v3/projects/cc71d5461ddf415d930a918d49285599 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:53:01.754477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:01.755911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:01.769692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d50981-e8d5-4f53-880a-d90aaeaffbf7 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:01.824329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:01.838128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:01.839054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:01.839341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:01.839619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] PATH_INFO: `/v3/users/c3a77f8699f54a84a6cbb1e25501b33a` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:01.840929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a77f8699f54a84a6cbb1e25501b33a)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:01.843701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:02.071561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a77f8699f54a84a6cbb1e25501b33a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:02.072815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a77f8699f54a84a6cbb1e25501b33a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:02.086434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a77f8699f54a84a6cbb1e25501b33a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:02.107664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a77f8699f54a84a6cbb1e25501b33a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:02.198718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a77f8699f54a84a6cbb1e25501b33a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:02.208999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1196/2419] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:53:01 2022] DELETE /identity/v3/users/c3a77f8699f54a84a6cbb1e25501b33a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:53:02.216731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86080-e5c6-4fd5-b7ed-9282228a22c0 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:02.217207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86080-e5c6-4fd5-b7ed-9282228a22c0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:02.217322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86080-e5c6-4fd5-b7ed-9282228a22c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:02.240666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-bdb86080-e5c6-4fd5-b7ed-9282228a22c0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:02.241869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bdb86080-e5c6-4fd5-b7ed-9282228a22c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:02.315222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1224/2420] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:53:02.325127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:02.327806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:02.392659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a58b-b12a-4002-b4a5-f4ba505726e5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:02.396452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37d9db-c497-4477-bb0f-d1cfb7ee363c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:02.397097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d9db-c497-4477-bb0f-d1cfb7ee363c service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:02.397380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d9db-c497-4477-bb0f-d1cfb7ee363c service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:02.397656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d9db-c497-4477-bb0f-d1cfb7ee363c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:02.406868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37d9db-c497-4477-bb0f-d1cfb7ee363c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:02.408362 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37d9db-c497-4477-bb0f-d1cfb7ee363c service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:02.417975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1197/2421] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:53:02.899424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb86080-e5c6-4fd5-b7ed-9282228a22c0 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:02.901382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bdb86080-e5c6-4fd5-b7ed-9282228a22c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:02.915507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb86080-e5c6-4fd5-b7ed-9282228a22c0 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:02.924567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:02.929450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:02.929450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:02.929450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] PATH_INFO: `/v3/projects/d29859ebe83140c3803f16b7d42de02a` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:02.929450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29859ebe83140c3803f16b7d42de02a)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:02.929450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:03.053793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29859ebe83140c3803f16b7d42de02a', 'request_id': 'req-d780081a-a8df-4e9b-8699-81980fab4506'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:03.063399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29859ebe83140c3803f16b7d42de02a', 'request_id': 'req-d780081a-a8df-4e9b-8699-81980fab4506'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:03.177478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29859ebe83140c3803f16b7d42de02a', 'request_id': 'req-d780081a-a8df-4e9b-8699-81980fab4506'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:03.189408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] The token cache is being invalidate because project d29859ebe83140c3803f16b7d42de02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:53:03.189705 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:03.190378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d780081a-a8df-4e9b-8699-81980fab4506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:03.192159 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1225/2422] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:53:02 2022] DELETE /identity/v3/projects/d29859ebe83140c3803f16b7d42de02a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:53:03.197258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523855-b2c6-4f62-b80d-08204733ae86 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:03.197779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523855-b2c6-4f62-b80d-08204733ae86 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:03.204856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523855-b2c6-4f62-b80d-08204733ae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:03.221050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c8523855-b2c6-4f62-b80d-08204733ae86 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:03.222262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c8523855-b2c6-4f62-b80d-08204733ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:03.281285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1198/2423] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:53:03.293418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffa5c3-1fb1-4daa-9550-863d6d6bf885 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:03.293418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffa5c3-1fb1-4daa-9550-863d6d6bf885 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:03.293418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffa5c3-1fb1-4daa-9550-863d6d6bf885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:03.308475 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-e8ffa5c3-1fb1-4daa-9550-863d6d6bf885 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:03.309679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e8ffa5c3-1fb1-4daa-9550-863d6d6bf885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:03.317859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1226/2424] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:53:03.321983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523855-b2c6-4f62-b80d-08204733ae86 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:03.332394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523855-b2c6-4f62-b80d-08204733ae86 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:03.337711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739b7d0-df29-4079-baeb-f4cd30cbe655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:03.338377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739b7d0-df29-4079-baeb-f4cd30cbe655 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:03.338687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739b7d0-df29-4079-baeb-f4cd30cbe655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:03.338951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739b7d0-df29-4079-baeb-f4cd30cbe655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:03.339684 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739b7d0-df29-4079-baeb-f4cd30cbe655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:53:03.339993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739b7d0-df29-4079-baeb-f4cd30cbe655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:03.342521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739b7d0-df29-4079-baeb-f4cd30cbe655 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:03.354673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1199/2425] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:53:03.358917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffa5c3-1fb1-4daa-9550-863d6d6bf885 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:03.364566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:03.368654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffa5c3-1fb1-4daa-9550-863d6d6bf885 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:03.373405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8b67c-167d-4236-afec-bf1d0c250805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:03.374137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8b67c-167d-4236-afec-bf1d0c250805 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:03.374352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8b67c-167d-4236-afec-bf1d0c250805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:03.374625 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8b67c-167d-4236-afec-bf1d0c250805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:03.375317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8b67c-167d-4236-afec-bf1d0c250805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:03.381433 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8b67c-167d-4236-afec-bf1d0c250805 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:03.519403 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1227/2426] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:53:03 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:53:03.520699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739b7d0-df29-4079-baeb-f4cd30cbe655 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:03.531265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739b7d0-df29-4079-baeb-f4cd30cbe655 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:03.535308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:03.588592 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1d56-632b-44b2-99d0-67ac5d3db4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:03.589270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1d56-632b-44b2-99d0-67ac5d3db4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:03.589552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1d56-632b-44b2-99d0-67ac5d3db4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:03.589829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1d56-632b-44b2-99d0-67ac5d3db4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:03.590518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1d56-632b-44b2-99d0-67ac5d3db4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:03.592789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1d56-632b-44b2-99d0-67ac5d3db4a1 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:03.701956 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1200/2427] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:53:03 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:53:03.706113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8b67c-167d-4236-afec-bf1d0c250805 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:03.721097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8b67c-167d-4236-afec-bf1d0c250805 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:03.729527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab35f54-bff9-4251-b8dc-ed3e2ccc9b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:03.733559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab35f54-bff9-4251-b8dc-ed3e2ccc9b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:03.733559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab35f54-bff9-4251-b8dc-ed3e2ccc9b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:03.733559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab35f54-bff9-4251-b8dc-ed3e2ccc9b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:03.733559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab35f54-bff9-4251-b8dc-ed3e2ccc9b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:03.733559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab35f54-bff9-4251-b8dc-ed3e2ccc9b69 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:03.750798 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1228/2428] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:53:03.752043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1d56-632b-44b2-99d0-67ac5d3db4a1 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:03.772079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1d56-632b-44b2-99d0-67ac5d3db4a1 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:03.777367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331d6e-e919-445e-8abc-9fb95abeb850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:03.778046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331d6e-e919-445e-8abc-9fb95abeb850 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:03.778332 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331d6e-e919-445e-8abc-9fb95abeb850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:03.778640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331d6e-e919-445e-8abc-9fb95abeb850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:03.780018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331d6e-e919-445e-8abc-9fb95abeb850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:03.781821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331d6e-e919-445e-8abc-9fb95abeb850 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:03.797466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1201/2429] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:53:03.801481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab35f54-bff9-4251-b8dc-ed3e2ccc9b69 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:03.813032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab35f54-bff9-4251-b8dc-ed3e2ccc9b69 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:03.817695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58a17b-f543-4872-8f89-79c5bb0b6416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:03.818580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58a17b-f543-4872-8f89-79c5bb0b6416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:03.818868 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58a17b-f543-4872-8f89-79c5bb0b6416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:03.819155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58a17b-f543-4872-8f89-79c5bb0b6416 admin admin] PATH_INFO: `/v3/projects/8886a272beed4b1cb3f79f2e8c62bf22/users/68cffba0776242ac9e54736b5a2c1dc0/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:03.835416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58a17b-f543-4872-8f89-79c5bb0b6416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8886a272beed4b1cb3f79f2e8c62bf22, user_id=68cffba0776242ac9e54736b5a2c1dc0, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:03.838150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58a17b-f543-4872-8f89-79c5bb0b6416 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:03.927259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1229/2430] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:53:03 2022] PUT /identity/v3/projects/8886a272beed4b1cb3f79f2e8c62bf22/users/68cffba0776242ac9e54736b5a2c1dc0/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:53:03.951060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b868-551d-4f56-a740-4b0406fedcb4 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:03.951442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b868-551d-4f56-a740-4b0406fedcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:03.951722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b868-551d-4f56-a740-4b0406fedcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:03.978056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7b78b868-551d-4f56-a740-4b0406fedcb4 None None] MFA Rules not processed for user `68cffba0776242ac9e54736b5a2c1dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:03.979279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7b78b868-551d-4f56-a740-4b0406fedcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:04.045421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1202/2431] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:53:04.056411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58a17b-f543-4872-8f89-79c5bb0b6416 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:04.058357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8c58a17b-f543-4872-8f89-79c5bb0b6416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:04.119503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58a17b-f543-4872-8f89-79c5bb0b6416 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:04.123964 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eea6f-3484-41be-b382-c61b6af0811f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:04.124645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eea6f-3484-41be-b382-c61b6af0811f service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:04.124937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eea6f-3484-41be-b382-c61b6af0811f service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:04.125219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eea6f-3484-41be-b382-c61b6af0811f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:04.133914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817eea6f-3484-41be-b382-c61b6af0811f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:04.138965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817eea6f-3484-41be-b382-c61b6af0811f service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:04.144460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1230/2432] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:53:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:53:06.891674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d256c8-e86d-433a-b7a4-c3448035a5c6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:06.892137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d256c8-e86d-433a-b7a4-c3448035a5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:06.892395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d256c8-e86d-433a-b7a4-c3448035a5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:06.910140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-28d256c8-e86d-433a-b7a4-c3448035a5c6 None None] MFA Rules not processed for user `0e90497b6d9c4a789f6b31680e069087`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:06.911356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-28d256c8-e86d-433a-b7a4-c3448035a5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:06.966556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1203/2433] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:53:14.140577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=48,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:16.959749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:46.422721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eea6f-3484-41be-b382-c61b6af0811f service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:46.424407 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-817eea6f-3484-41be-b382-c61b6af0811f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:46.497214 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eea6f-3484-41be-b382-c61b6af0811f service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:46.503532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006f1fa-dc7d-4625-9555-a23302c1fb98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:46.504103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006f1fa-dc7d-4625-9555-a23302c1fb98 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:46.504547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006f1fa-dc7d-4625-9555-a23302c1fb98 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:46.504829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006f1fa-dc7d-4625-9555-a23302c1fb98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:46.506599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6006f1fa-dc7d-4625-9555-a23302c1fb98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:46.518466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006f1fa-dc7d-4625-9555-a23302c1fb98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:46.520099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006f1fa-dc7d-4625-9555-a23302c1fb98 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:46.530596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1231/2434] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:53:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:53:50.231264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d256c8-e86d-433a-b7a4-c3448035a5c6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:50.298502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d256c8-e86d-433a-b7a4-c3448035a5c6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:50.302960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:50.303820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:50.304095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:50.304394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] PATH_INFO: `/v3/users/68cffba0776242ac9e54736b5a2c1dc0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:50.305580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cffba0776242ac9e54736b5a2c1dc0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:50.307503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:50.488509 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cffba0776242ac9e54736b5a2c1dc0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:50.489194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cffba0776242ac9e54736b5a2c1dc0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:50.496499 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cffba0776242ac9e54736b5a2c1dc0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:50.508536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cffba0776242ac9e54736b5a2c1dc0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:50.577403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cffba0776242ac9e54736b5a2c1dc0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:50.583781 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1204/2435] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:53:50 2022] DELETE /identity/v3/users/68cffba0776242ac9e54736b5a2c1dc0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:53:50.588615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc5c0c-5bc3-43da-8627-b883267476e8 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:50.589125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc5c0c-5bc3-43da-8627-b883267476e8 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:50.589236 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc5c0c-5bc3-43da-8627-b883267476e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:50.606672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-0cbc5c0c-5bc3-43da-8627-b883267476e8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:50.607961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0cbc5c0c-5bc3-43da-8627-b883267476e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:50.669746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1232/2436] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:53:50.679440 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:50.680914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:50.744062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a40dc-a317-45ab-91df-3b14d1edbf2a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:50.748244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ef66-0416-4785-bd78-b1fdd329f6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:50.748909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ef66-0416-4785-bd78-b1fdd329f6bc service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:50.753390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ef66-0416-4785-bd78-b1fdd329f6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:50.753390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ef66-0416-4785-bd78-b1fdd329f6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:50.758444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ef66-0416-4785-bd78-b1fdd329f6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:50.759911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ef66-0416-4785-bd78-b1fdd329f6bc service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:50.769917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1205/2437] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:53:50.813843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bce3-7a4f-4de1-a490-34fdf2dcae40 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:50.814163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bce3-7a4f-4de1-a490-34fdf2dcae40 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:50.814446 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bce3-7a4f-4de1-a490-34fdf2dcae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:50.834630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c816bce3-7a4f-4de1-a490-34fdf2dcae40 None None] MFA Rules not processed for user `718a82d2f4294f68965ce01aac0fc166`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:50.835800 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c816bce3-7a4f-4de1-a490-34fdf2dcae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:50.893156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1233/2438] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:53:51.285207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ef66-0416-4785-bd78-b1fdd329f6bc service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:51.287314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2a70ef66-0416-4785-bd78-b1fdd329f6bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:51.303561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ef66-0416-4785-bd78-b1fdd329f6bc service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:51.310483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:51.311646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:51.312146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:51.313783 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] PATH_INFO: `/v3/projects/8886a272beed4b1cb3f79f2e8c62bf22` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:51.315308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8886a272beed4b1cb3f79f2e8c62bf22)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:51.317576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:51.336007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:51.422777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8886a272beed4b1cb3f79f2e8c62bf22', 'request_id': 'req-df03e66f-bdb1-43c1-b16b-050c76e61327'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:51.506339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8886a272beed4b1cb3f79f2e8c62bf22', 'request_id': 'req-df03e66f-bdb1-43c1-b16b-050c76e61327'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:51.514544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8886a272beed4b1cb3f79f2e8c62bf22', 'request_id': 'req-df03e66f-bdb1-43c1-b16b-050c76e61327'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:51.525227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] The token cache is being invalidate because project 8886a272beed4b1cb3f79f2e8c62bf22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:53:51.525511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:51.526172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-df03e66f-bdb1-43c1-b16b-050c76e61327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:53:51.527721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1206/2439] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:53:51 2022] DELETE /identity/v3/projects/8886a272beed4b1cb3f79f2e8c62bf22 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:53:51.533262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e3a9a-a10f-4d6e-a904-007ccdf4d460 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:51.533566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e3a9a-a10f-4d6e-a904-007ccdf4d460 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:51.533850 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e3a9a-a10f-4d6e-a904-007ccdf4d460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:51.551991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-9e4e3a9a-a10f-4d6e-a904-007ccdf4d460 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:51.553222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9e4e3a9a-a10f-4d6e-a904-007ccdf4d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:51.587866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:51.628036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1234/2440] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:53:51.630420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840e75-d428-4f4c-85e4-486cb594e06f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:51.630708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840e75-d428-4f4c-85e4-486cb594e06f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:51.635015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840e75-d428-4f4c-85e4-486cb594e06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:51.651262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1b840e75-d428-4f4c-85e4-486cb594e06f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:51.652502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1b840e75-d428-4f4c-85e4-486cb594e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:51.664539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1207/2441] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:53:51.666285 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e3a9a-a10f-4d6e-a904-007ccdf4d460 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:51.681553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e3a9a-a10f-4d6e-a904-007ccdf4d460 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:51.683687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df190e08-1753-4691-8196-422fb76471d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:51.684937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df190e08-1753-4691-8196-422fb76471d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:51.685262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df190e08-1753-4691-8196-422fb76471d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:51.685546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df190e08-1753-4691-8196-422fb76471d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:51.686284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df190e08-1753-4691-8196-422fb76471d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:53:51.686643 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df190e08-1753-4691-8196-422fb76471d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:51.688387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df190e08-1753-4691-8196-422fb76471d4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:51.703251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1235/2442] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:53:51.713152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840e75-d428-4f4c-85e4-486cb594e06f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:51.725524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840e75-d428-4f4c-85e4-486cb594e06f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:51.732181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965905c9-5f4d-479e-85dc-9f118bb74a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:51.745074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965905c9-5f4d-479e-85dc-9f118bb74a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:51.745074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965905c9-5f4d-479e-85dc-9f118bb74a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:51.745074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965905c9-5f4d-479e-85dc-9f118bb74a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:51.745074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965905c9-5f4d-479e-85dc-9f118bb74a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:51.745074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965905c9-5f4d-479e-85dc-9f118bb74a52 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:51.853147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1208/2443] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:53:51 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:53:51.857693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df190e08-1753-4691-8196-422fb76471d4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:51.867940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df190e08-1753-4691-8196-422fb76471d4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:51.924668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3317a-046e-4df8-9b51-dfee0fee25a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:51.925332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3317a-046e-4df8-9b51-dfee0fee25a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:51.925621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3317a-046e-4df8-9b51-dfee0fee25a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:51.925893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3317a-046e-4df8-9b51-dfee0fee25a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:51.926567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3317a-046e-4df8-9b51-dfee0fee25a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:51.928509 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3317a-046e-4df8-9b51-dfee0fee25a5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:52.027047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1236/2444] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:53:51 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:53:52.031226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965905c9-5f4d-479e-85dc-9f118bb74a52 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:52.041745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965905c9-5f4d-479e-85dc-9f118bb74a52 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:52.046899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93feb8c-53e9-4ca8-af73-d3dd248bbb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:52.047558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93feb8c-53e9-4ca8-af73-d3dd248bbb7f admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:52.047848 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93feb8c-53e9-4ca8-af73-d3dd248bbb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:52.048141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93feb8c-53e9-4ca8-af73-d3dd248bbb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:52.048953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93feb8c-53e9-4ca8-af73-d3dd248bbb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:52.050564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93feb8c-53e9-4ca8-af73-d3dd248bbb7f admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:52.061777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1209/2445] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:53:52.072153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3317a-046e-4df8-9b51-dfee0fee25a5 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:52.083038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3317a-046e-4df8-9b51-dfee0fee25a5 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:52.090110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abe290-93a0-4555-b35e-0755b36190a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:52.091408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abe290-93a0-4555-b35e-0755b36190a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:52.091774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abe290-93a0-4555-b35e-0755b36190a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:52.092274 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abe290-93a0-4555-b35e-0755b36190a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:52.093687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abe290-93a0-4555-b35e-0755b36190a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:52.095396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abe290-93a0-4555-b35e-0755b36190a0 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:52.113169 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1237/2446] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:53:52.115331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93feb8c-53e9-4ca8-af73-d3dd248bbb7f admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:52.125771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93feb8c-53e9-4ca8-af73-d3dd248bbb7f admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:52.130856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85561d0-dbcb-4ee4-8cc5-120d43887c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:52.131757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85561d0-dbcb-4ee4-8cc5-120d43887c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:52.132043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85561d0-dbcb-4ee4-8cc5-120d43887c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:52.132346 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85561d0-dbcb-4ee4-8cc5-120d43887c60 admin admin] PATH_INFO: `/v3/projects/3b8b6040463b48f7996ea207d972a6df/users/8cef45a05752411fad6550bd29f0b797/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:52.148070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85561d0-dbcb-4ee4-8cc5-120d43887c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8b6040463b48f7996ea207d972a6df, user_id=8cef45a05752411fad6550bd29f0b797, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:52.150788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85561d0-dbcb-4ee4-8cc5-120d43887c60 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:52.267112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1210/2447] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:53:52 2022] PUT /identity/v3/projects/3b8b6040463b48f7996ea207d972a6df/users/8cef45a05752411fad6550bd29f0b797/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:53:52.277292 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9c495-606c-4d35-a491-5d0866903f84 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:52.277595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9c495-606c-4d35-a491-5d0866903f84 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:52.278440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9c495-606c-4d35-a491-5d0866903f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:52.305845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d0d9c495-606c-4d35-a491-5d0866903f84 None None] MFA Rules not processed for user `8cef45a05752411fad6550bd29f0b797`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:53:52.307059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d0d9c495-606c-4d35-a491-5d0866903f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:52.382894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1238/2448] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:53:52.394299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85561d0-dbcb-4ee4-8cc5-120d43887c60 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:53:52.396260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e85561d0-dbcb-4ee4-8cc5-120d43887c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:53:52.457455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85561d0-dbcb-4ee4-8cc5-120d43887c60 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:53:52.461420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ea6fd-7d08-4bed-8e3d-b037dee159c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:53:52.462063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ea6fd-7d08-4bed-8e3d-b037dee159c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:53:52.462345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ea6fd-7d08-4bed-8e3d-b037dee159c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:53:52.462622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ea6fd-7d08-4bed-8e3d-b037dee159c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:53:52.471443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ea6fd-7d08-4bed-8e3d-b037dee159c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:53:52.472867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ea6fd-7d08-4bed-8e3d-b037dee159c3 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:53:52.482385 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1211/2449] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:53:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:54:02.379926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:02.477534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:17.696241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9c495-606c-4d35-a491-5d0866903f84 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:17.756951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9c495-606c-4d35-a491-5d0866903f84 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:17.761403 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:17.762478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:17.762761 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:17.763036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] PATH_INFO: `/v3/users/8cef45a05752411fad6550bd29f0b797` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:17.764209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cef45a05752411fad6550bd29f0b797)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:17.766167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:17.919779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cef45a05752411fad6550bd29f0b797'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:17.997471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cef45a05752411fad6550bd29f0b797'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:17.998016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cef45a05752411fad6550bd29f0b797'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:17.998641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cef45a05752411fad6550bd29f0b797'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:18.005778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cef45a05752411fad6550bd29f0b797'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:18.023560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1239/2450] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:54:17 2022] DELETE /identity/v3/users/8cef45a05752411fad6550bd29f0b797 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:18.028184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb03813-52d8-46f4-8724-bb1449c98313 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:18.028668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb03813-52d8-46f4-8724-bb1449c98313 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:18.028765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb03813-52d8-46f4-8724-bb1449c98313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:18.045658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1fb03813-52d8-46f4-8724-bb1449c98313 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:18.046839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1fb03813-52d8-46f4-8724-bb1449c98313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:18.109390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1212/2451] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:18.119238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:18.120735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:18.182219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4a0c0-70e8-4b5c-b8a2-d65c7261a4ca admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:18.188849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dab67-9670-4d81-91b8-4bdf8a96176e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:18.189505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dab67-9670-4d81-91b8-4bdf8a96176e service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:18.189792 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dab67-9670-4d81-91b8-4bdf8a96176e service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:18.190097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dab67-9670-4d81-91b8-4bdf8a96176e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:18.199586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0dab67-9670-4d81-91b8-4bdf8a96176e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:18.201071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0dab67-9670-4d81-91b8-4bdf8a96176e service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:18.211023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1240/2452] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:54:18.939644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb03813-52d8-46f4-8724-bb1449c98313 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:18.941293 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1fb03813-52d8-46f4-8724-bb1449c98313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:18.954290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb03813-52d8-46f4-8724-bb1449c98313 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:18.959262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:18.960131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:18.960491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:18.960760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] PATH_INFO: `/v3/projects/3b8b6040463b48f7996ea207d972a6df` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:18.961969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8b6040463b48f7996ea207d972a6df)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:18.964361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.069209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8b6040463b48f7996ea207d972a6df', 'request_id': 'req-9be54a41-4e0a-4d13-9a76-7968b95a4451'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:19.143153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8b6040463b48f7996ea207d972a6df', 'request_id': 'req-9be54a41-4e0a-4d13-9a76-7968b95a4451'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:19.151929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8b6040463b48f7996ea207d972a6df', 'request_id': 'req-9be54a41-4e0a-4d13-9a76-7968b95a4451'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:19.162901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] The token cache is being invalidate because project 3b8b6040463b48f7996ea207d972a6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:54:19.163186 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:19.163801 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9be54a41-4e0a-4d13-9a76-7968b95a4451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:54:19.165373 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1213/2453] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:54:18 2022] DELETE /identity/v3/projects/3b8b6040463b48f7996ea207d972a6df => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:19.170409 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e985a7e-a08e-498e-9f4d-07df76523e12 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.170882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e985a7e-a08e-498e-9f4d-07df76523e12 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.170998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e985a7e-a08e-498e-9f4d-07df76523e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.188246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-4e985a7e-a08e-498e-9f4d-07df76523e12 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:19.189455 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4e985a7e-a08e-498e-9f4d-07df76523e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:19.207119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:19.252802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1241/2454] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:54:19.261150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065cc15-67e8-4f37-abf3-775010751340 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.261446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065cc15-67e8-4f37-abf3-775010751340 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.261728 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065cc15-67e8-4f37-abf3-775010751340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.282260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-f065cc15-67e8-4f37-abf3-775010751340 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:19.283592 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f065cc15-67e8-4f37-abf3-775010751340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:19.291785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1214/2455] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:19.296027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e985a7e-a08e-498e-9f4d-07df76523e12 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.305985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e985a7e-a08e-498e-9f4d-07df76523e12 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.311291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb1a90-bde1-418f-8908-a92db9c2be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.311949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb1a90-bde1-418f-8908-a92db9c2be98 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.318353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb1a90-bde1-418f-8908-a92db9c2be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.318353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb1a90-bde1-418f-8908-a92db9c2be98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.318353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb1a90-bde1-418f-8908-a92db9c2be98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:54:19.318353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb1a90-bde1-418f-8908-a92db9c2be98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.318353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb1a90-bde1-418f-8908-a92db9c2be98 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.328011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1242/2456] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:54:19.332438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065cc15-67e8-4f37-abf3-775010751340 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.342342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065cc15-67e8-4f37-abf3-775010751340 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.347409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d3428-bf67-401e-b70f-5e17056bfa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.348078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d3428-bf67-401e-b70f-5e17056bfa82 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.348406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d3428-bf67-401e-b70f-5e17056bfa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.348675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d3428-bf67-401e-b70f-5e17056bfa82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.349378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d3428-bf67-401e-b70f-5e17056bfa82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.351342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d3428-bf67-401e-b70f-5e17056bfa82 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.431073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1215/2457] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:54:19 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:54:19.435270 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb1a90-bde1-418f-8908-a92db9c2be98 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.445373 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb1a90-bde1-418f-8908-a92db9c2be98 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.500954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20071214-2363-4033-93f5-bfc61567aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.501631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20071214-2363-4033-93f5-bfc61567aead admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.501923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20071214-2363-4033-93f5-bfc61567aead admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.502205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20071214-2363-4033-93f5-bfc61567aead admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.502912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20071214-2363-4033-93f5-bfc61567aead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.504878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20071214-2363-4033-93f5-bfc61567aead admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.607548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1243/2458] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:54:19 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:54:19.608874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d3428-bf67-401e-b70f-5e17056bfa82 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.619799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d3428-bf67-401e-b70f-5e17056bfa82 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.624654 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f84471-98dc-46a5-a15d-ade12b30a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.625358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f84471-98dc-46a5-a15d-ade12b30a844 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.625639 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f84471-98dc-46a5-a15d-ade12b30a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.625914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f84471-98dc-46a5-a15d-ade12b30a844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.626686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f84471-98dc-46a5-a15d-ade12b30a844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.628307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f84471-98dc-46a5-a15d-ade12b30a844 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.639834 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1216/2459] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:54:19.643968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20071214-2363-4033-93f5-bfc61567aead admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.654851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20071214-2363-4033-93f5-bfc61567aead admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.659765 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36427b7-fe4b-402f-8375-1a7c45790c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.660490 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36427b7-fe4b-402f-8375-1a7c45790c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.660774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36427b7-fe4b-402f-8375-1a7c45790c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.661044 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36427b7-fe4b-402f-8375-1a7c45790c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.661786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36427b7-fe4b-402f-8375-1a7c45790c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.663415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36427b7-fe4b-402f-8375-1a7c45790c61 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.674346 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1244/2460] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:54:19.678752 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f84471-98dc-46a5-a15d-ade12b30a844 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.689330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f84471-98dc-46a5-a15d-ade12b30a844 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.694094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b45fd-5eff-4fb8-818f-6e5714cdbcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.694978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b45fd-5eff-4fb8-818f-6e5714cdbcb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.695261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b45fd-5eff-4fb8-818f-6e5714cdbcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.695588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b45fd-5eff-4fb8-818f-6e5714cdbcb2 admin admin] PATH_INFO: `/v3/projects/8d09d9819e564152aacc661d1da68fcd/users/2aa01ac54736475188dbc47f3cda4de1/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.711365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b45fd-5eff-4fb8-818f-6e5714cdbcb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d09d9819e564152aacc661d1da68fcd, user_id=2aa01ac54736475188dbc47f3cda4de1, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.714195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b45fd-5eff-4fb8-818f-6e5714cdbcb2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.789119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1217/2461] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:54:19 2022] PUT /identity/v3/projects/8d09d9819e564152aacc661d1da68fcd/users/2aa01ac54736475188dbc47f3cda4de1/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:19.795602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601a88-2d2e-4083-814e-8eefcce70fd4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.795895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601a88-2d2e-4083-814e-8eefcce70fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.796177 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601a88-2d2e-4083-814e-8eefcce70fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.816070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-41601a88-2d2e-4083-814e-8eefcce70fd4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:19.817317 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-41601a88-2d2e-4083-814e-8eefcce70fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:19.878425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1245/2462] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:19.889806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b45fd-5eff-4fb8-818f-6e5714cdbcb2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:19.891575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-095b45fd-5eff-4fb8-818f-6e5714cdbcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:19.915917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:19.952411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b45fd-5eff-4fb8-818f-6e5714cdbcb2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:19.956207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12ae99-47aa-4055-8a03-cbad74cb3033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:19.956905 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12ae99-47aa-4055-8a03-cbad74cb3033 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:19.957195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12ae99-47aa-4055-8a03-cbad74cb3033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:19.957662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12ae99-47aa-4055-8a03-cbad74cb3033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:19.971220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12ae99-47aa-4055-8a03-cbad74cb3033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:19.973331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12ae99-47aa-4055-8a03-cbad74cb3033 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:19.984200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1218/2463] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:54:22.911199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1e1a-e374-4369-befa-187f3421714e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:22.911724 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1e1a-e374-4369-befa-187f3421714e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:22.911808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1e1a-e374-4369-befa-187f3421714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:22.930492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-aabf1e1a-e374-4369-befa-187f3421714e None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:22.931697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-aabf1e1a-e374-4369-befa-187f3421714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:22.958235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:22.995401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1246/2464] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:54:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:23.142692 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12ae99-47aa-4055-8a03-cbad74cb3033 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:23.145196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7d12ae99-47aa-4055-8a03-cbad74cb3033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:23.262336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12ae99-47aa-4055-8a03-cbad74cb3033 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:23.270960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41bb7-12df-4751-9748-6f3e28ecf4c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:23.273280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41bb7-12df-4751-9748-6f3e28ecf4c0 service swift] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:23.273280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41bb7-12df-4751-9748-6f3e28ecf4c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:23.274161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41bb7-12df-4751-9748-6f3e28ecf4c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:23.293529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e41bb7-12df-4751-9748-6f3e28ecf4c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:23.300419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e41bb7-12df-4751-9748-6f3e28ecf4c0 service swift] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:23.314116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1219/2465] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:54:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:54:25.786897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2bba6-857c-4bc8-bcf2-fc363f18ed44 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:25.787970 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2bba6-857c-4bc8-bcf2-fc363f18ed44 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:25.788456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2bba6-857c-4bc8-bcf2-fc363f18ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:25.828856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-f5e2bba6-857c-4bc8-bcf2-fc363f18ed44 None None] MFA Rules not processed for user `2aa01ac54736475188dbc47f3cda4de1`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:25.830018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f5e2bba6-857c-4bc8-bcf2-fc363f18ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:25.907659 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1247/2466] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:54:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:25.911928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41bb7-12df-4751-9748-6f3e28ecf4c0 service swift] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:25.923582 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41bb7-12df-4751-9748-6f3e28ecf4c0 service swift] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:25.933325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48689cd9-fa64-4f8b-aefd-3d2fbad8b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:25.933889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48689cd9-fa64-4f8b-aefd-3d2fbad8b902 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:25.934457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48689cd9-fa64-4f8b-aefd-3d2fbad8b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:25.934742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48689cd9-fa64-4f8b-aefd-3d2fbad8b902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:25.935771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48689cd9-fa64-4f8b-aefd-3d2fbad8b902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:25.937627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48689cd9-fa64-4f8b-aefd-3d2fbad8b902 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:26.060362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2bba6-857c-4bc8-bcf2-fc363f18ed44 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:26.067139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1220/2467] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:54:25 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:54:26.072202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2bba6-857c-4bc8-bcf2-fc363f18ed44 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:26.170661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d34cd1-7c95-4db8-8600-8e504ec980d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:26.171483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d34cd1-7c95-4db8-8600-8e504ec980d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:26.171772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d34cd1-7c95-4db8-8600-8e504ec980d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:26.172056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d34cd1-7c95-4db8-8600-8e504ec980d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:26.172925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d34cd1-7c95-4db8-8600-8e504ec980d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:26.174909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d34cd1-7c95-4db8-8600-8e504ec980d5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:26.284364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1248/2468] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:54:26 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:54:26.285856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48689cd9-fa64-4f8b-aefd-3d2fbad8b902 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:26.300152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48689cd9-fa64-4f8b-aefd-3d2fbad8b902 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:26.304971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31285d1c-f835-4812-a776-41b4f13fe518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:26.305636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31285d1c-f835-4812-a776-41b4f13fe518 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:26.305918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31285d1c-f835-4812-a776-41b4f13fe518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:26.306196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31285d1c-f835-4812-a776-41b4f13fe518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:26.306920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31285d1c-f835-4812-a776-41b4f13fe518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:26.311607 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31285d1c-f835-4812-a776-41b4f13fe518 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:26.326731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1221/2469] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:54:26.329474 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d34cd1-7c95-4db8-8600-8e504ec980d5 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:26.352938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d34cd1-7c95-4db8-8600-8e504ec980d5 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:26.361484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc86880-2532-4b1d-858f-7131fee1baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:26.361484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc86880-2532-4b1d-858f-7131fee1baed admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:26.361484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc86880-2532-4b1d-858f-7131fee1baed admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:26.361484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc86880-2532-4b1d-858f-7131fee1baed admin admin] PATH_INFO: `/v3/projects/329486f3fa4d426b982fa352f8a57f1a/users/c7a20d27749940319d31c144a5c12787/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:26.380890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc86880-2532-4b1d-858f-7131fee1baed admin admin] RBAC: Authorizing `identity:create_grant(project_id=329486f3fa4d426b982fa352f8a57f1a, user_id=c7a20d27749940319d31c144a5c12787, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:26.383706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc86880-2532-4b1d-858f-7131fee1baed admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:26.568554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1249/2470] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:54:26 2022] PUT /identity/v3/projects/329486f3fa4d426b982fa352f8a57f1a/users/c7a20d27749940319d31c144a5c12787/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:26.571921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31285d1c-f835-4812-a776-41b4f13fe518 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:26.587920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31285d1c-f835-4812-a776-41b4f13fe518 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:26.701891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2dea4-a076-45eb-b4fa-d2218cd7e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:26.703053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2dea4-a076-45eb-b4fa-d2218cd7e799 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:26.703625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2dea4-a076-45eb-b4fa-d2218cd7e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:26.704180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2dea4-a076-45eb-b4fa-d2218cd7e799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:26.705640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2dea4-a076-45eb-b4fa-d2218cd7e799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:26.707553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2dea4-a076-45eb-b4fa-d2218cd7e799 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:26.728584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1222/2471] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:54:26.733189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc86880-2532-4b1d-858f-7131fee1baed admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:26.746416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc86880-2532-4b1d-858f-7131fee1baed admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:26.752355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bdac8-86ce-4992-8d63-5dc49a914932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:26.753357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bdac8-86ce-4992-8d63-5dc49a914932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:26.753721 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bdac8-86ce-4992-8d63-5dc49a914932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:26.754079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bdac8-86ce-4992-8d63-5dc49a914932 admin admin] PATH_INFO: `/v3/projects/329486f3fa4d426b982fa352f8a57f1a/users/c7a20d27749940319d31c144a5c12787/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:26.756412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bdac8-86ce-4992-8d63-5dc49a914932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329486f3fa4d426b982fa352f8a57f1a, user_id=c7a20d27749940319d31c144a5c12787, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:26.759370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bdac8-86ce-4992-8d63-5dc49a914932 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:26.775527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1250/2472] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:54:26 2022] PUT /identity/v3/projects/329486f3fa4d426b982fa352f8a57f1a/users/c7a20d27749940319d31c144a5c12787/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:54:34.277751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85149-e085-4ee5-90e5-55fc6362d5cd None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:34.278304 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85149-e085-4ee5-90e5-55fc6362d5cd None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:34.278577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85149-e085-4ee5-90e5-55fc6362d5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:34.332449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9bf85149-e085-4ee5-90e5-55fc6362d5cd None None] MFA Rules not processed for user `c7a20d27749940319d31c144a5c12787`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:34.332449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9bf85149-e085-4ee5-90e5-55fc6362d5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:34.339267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:34.484274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1223/2473] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:54:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:34.500196 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bdac8-86ce-4992-8d63-5dc49a914932 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:34.502020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-991bdac8-86ce-4992-8d63-5dc49a914932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:34.533608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:34.616671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bdac8-86ce-4992-8d63-5dc49a914932 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:34.623696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fac6e-c237-4bea-89d7-6db47c6ec5fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:34.624232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fac6e-c237-4bea-89d7-6db47c6ec5fa service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:34.626137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fac6e-c237-4bea-89d7-6db47c6ec5fa service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:34.626430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fac6e-c237-4bea-89d7-6db47c6ec5fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:34.773842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fac6e-c237-4bea-89d7-6db47c6ec5fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:34.779600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fac6e-c237-4bea-89d7-6db47c6ec5fa service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:34.812726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1251/2474] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:54:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:54:44.359016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853138ef-a1df-4a9a-bfaf-954b251afdf4 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.359632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853138ef-a1df-4a9a-bfaf-954b251afdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.359632 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853138ef-a1df-4a9a-bfaf-954b251afdf4 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.361018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1224/2475] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:44.367083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1d9c-2ccc-4d67-8ef9-c899a5b04243 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.367575 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1d9c-2ccc-4d67-8ef9-c899a5b04243 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.367683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1d9c-2ccc-4d67-8ef9-c899a5b04243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.385684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-bfad1d9c-2ccc-4d67-8ef9-c899a5b04243 None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:44.387428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bfad1d9c-2ccc-4d67-8ef9-c899a5b04243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:44.398065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1252/2476] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:54:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:44.410836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853138ef-a1df-4a9a-bfaf-954b251afdf4 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:44.412729 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-853138ef-a1df-4a9a-bfaf-954b251afdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:44.474925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853138ef-a1df-4a9a-bfaf-954b251afdf4 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:44.478494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f306c-4489-4dcb-9dea-880dfed7991a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9533e8371e64161a4c54eeab867a17e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:44.479133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f306c-4489-4dcb-9dea-880dfed7991a service glance] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.479415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f306c-4489-4dcb-9dea-880dfed7991a service glance] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.479694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f306c-4489-4dcb-9dea-880dfed7991a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.490137 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f306c-4489-4dcb-9dea-880dfed7991a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:44.491572 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f306c-4489-4dcb-9dea-880dfed7991a service glance] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:44.502706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1225/2477] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:54:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:54:44.732459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf9b3f-1144-4391-a5b4-8c4346bc6d32 None None] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.732459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf9b3f-1144-4391-a5b4-8c4346bc6d32 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.732459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf9b3f-1144-4391-a5b4-8c4346bc6d32 None None] PATH_INFO: `/` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.732879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1253/2478] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:44.741623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972c2f-37ff-47c6-96fa-936de04cb0a6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.741911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972c2f-37ff-47c6-96fa-936de04cb0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.742189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972c2f-37ff-47c6-96fa-936de04cb0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.762476 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8e972c2f-37ff-47c6-96fa-936de04cb0a6 None None] MFA Rules not processed for user `a833149a66af4452aeedd5d43f2fb2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:44.763784 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8e972c2f-37ff-47c6-96fa-936de04cb0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:44.817560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1226/2479] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:54:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:44.829657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf9b3f-1144-4391-a5b4-8c4346bc6d32 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:44.831339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d1bf9b3f-1144-4391-a5b4-8c4346bc6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:44.845040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf9b3f-1144-4391-a5b4-8c4346bc6d32 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:44.848587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591e650-2644-4b42-b938-087f0b5ed208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:44.849218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591e650-2644-4b42-b938-087f0b5ed208 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.849502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591e650-2644-4b42-b938-087f0b5ed208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.849780 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591e650-2644-4b42-b938-087f0b5ed208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.856926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591e650-2644-4b42-b938-087f0b5ed208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:44.858360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591e650-2644-4b42-b938-087f0b5ed208 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:44.866585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1254/2480] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:54:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:54:44.951649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd03eb-c034-4add-8d63-2b39e7f97da6 None None] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.951939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd03eb-c034-4add-8d63-2b39e7f97da6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.952219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd03eb-c034-4add-8d63-2b39e7f97da6 None None] PATH_INFO: `/` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.953655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1227/2481] 10.222.0.74 () {54 vars in 921 bytes} [Mon May 23 16:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:54:44.959117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ccf3-1a4e-48c9-a230-95ab9a6dbe2d None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:44.959434 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ccf3-1a4e-48c9-a230-95ab9a6dbe2d None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:44.959714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ccf3-1a4e-48c9-a230-95ab9a6dbe2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:44.977742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-57e6ccf3-1a4e-48c9-a230-95ab9a6dbe2d None None] MFA Rules not processed for user `951eca3289634609bcb684181e147ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:44.978962 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-57e6ccf3-1a4e-48c9-a230-95ab9a6dbe2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:44.988407 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1255/2482] 10.222.0.74 () {58 vars in 1018 bytes} [Mon May 23 16:54:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:44.999832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd03eb-c034-4add-8d63-2b39e7f97da6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:45.011083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd03eb-c034-4add-8d63-2b39e7f97da6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:45.015363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc5148-b274-4f16-9d26-98c44f84e2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:45.016004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc5148-b274-4f16-9d26-98c44f84e2ad service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:45.016288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc5148-b274-4f16-9d26-98c44f84e2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:45.016589 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc5148-b274-4f16-9d26-98c44f84e2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:45.026733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc5148-b274-4f16-9d26-98c44f84e2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:45.028178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc5148-b274-4f16-9d26-98c44f84e2ad service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:45.038834 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1228/2483] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:54:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:54:47.299107 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b641-94a8-4848-88c8-8561cb1784bb None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:47.299614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b641-94a8-4848-88c8-8561cb1784bb None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:47.299711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b641-94a8-4848-88c8-8561cb1784bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:47.318397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-1066b641-94a8-4848-88c8-8561cb1784bb None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:54:47.319592 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1066b641-94a8-4848-88c8-8561cb1784bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:54:47.374694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1256/2484] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:54:47.387242 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc5148-b274-4f16-9d26-98c44f84e2ad service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:54:47.431800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:47.455543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc5148-b274-4f16-9d26-98c44f84e2ad service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:54:47.460808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063bffc-47b8-47ae-ac16-2c846ecfc940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:54:47.461448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063bffc-47b8-47ae-ac16-2c846ecfc940 service swift] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:54:47.461731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063bffc-47b8-47ae-ac16-2c846ecfc940 service swift] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:54:47.462007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063bffc-47b8-47ae-ac16-2c846ecfc940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:54:47.471155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063bffc-47b8-47ae-ac16-2c846ecfc940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:54:47.472778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063bffc-47b8-47ae-ac16-2c846ecfc940 service swift] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:54:47.480824 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1229/2485] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:54:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:54:57.367262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=86 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:57.477438 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=14 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:02.602680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8183184-078f-407e-a6dc-202add2db8d8 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:02.603229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8183184-078f-407e-a6dc-202add2db8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:02.603351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8183184-078f-407e-a6dc-202add2db8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:02.622827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d8183184-078f-407e-a6dc-202add2db8d8 None None] MFA Rules not processed for user `2aa01ac54736475188dbc47f3cda4de1`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:02.624039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d8183184-078f-407e-a6dc-202add2db8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:02.630921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1257/2486] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:09.987637 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189c1f2-ca6d-4da7-a747-7b4973d17a58 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:09.988114 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189c1f2-ca6d-4da7-a747-7b4973d17a58 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:09.988223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189c1f2-ca6d-4da7-a747-7b4973d17a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.006023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b189c1f2-ca6d-4da7-a747-7b4973d17a58 None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:10.007210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b189c1f2-ca6d-4da7-a747-7b4973d17a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:10.014924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1230/2487] 10.222.0.74 () {58 vars in 967 bytes} [Mon May 23 16:55:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:10.026905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8183184-078f-407e-a6dc-202add2db8d8 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:10.039817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8183184-078f-407e-a6dc-202add2db8d8 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:10.045287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e3bf-a249-4894-a7fe-3cfd85de0812 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:10.045923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e3bf-a249-4894-a7fe-3cfd85de0812 service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:10.046212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e3bf-a249-4894-a7fe-3cfd85de0812 service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:10.046519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e3bf-a249-4894-a7fe-3cfd85de0812 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:10.054608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e3bf-a249-4894-a7fe-3cfd85de0812 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:10.056206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e3bf-a249-4894-a7fe-3cfd85de0812 service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:10.065209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1258/2488] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:55:20.000662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:20.061709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=9 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:26.317772 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189c1f2-ca6d-4da7-a747-7b4973d17a58 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:26.328996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189c1f2-ca6d-4da7-a747-7b4973d17a58 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:26.332840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d9cea-9cb4-47c5-85b7-b90b8e4841fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:26.333753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d9cea-9cb4-47c5-85b7-b90b8e4841fb service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:26.334026 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d9cea-9cb4-47c5-85b7-b90b8e4841fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:26.334303 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d9cea-9cb4-47c5-85b7-b90b8e4841fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:26.343965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d9cea-9cb4-47c5-85b7-b90b8e4841fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:26.345445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d9cea-9cb4-47c5-85b7-b90b8e4841fb service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:26.355099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1231/2489] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:55:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:55:31.150771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e3bf-a249-4894-a7fe-3cfd85de0812 service swift] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:31.160137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e3bf-a249-4894-a7fe-3cfd85de0812 service swift] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:31.163640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab474f0-fed3-4cb2-b59d-c6935bdee278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:31.164263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab474f0-fed3-4cb2-b59d-c6935bdee278 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:31.164602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab474f0-fed3-4cb2-b59d-c6935bdee278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:31.164862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab474f0-fed3-4cb2-b59d-c6935bdee278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:31.166582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1ab474f0-fed3-4cb2-b59d-c6935bdee278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:31.180001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab474f0-fed3-4cb2-b59d-c6935bdee278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:31.181456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab474f0-fed3-4cb2-b59d-c6935bdee278 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:31.192833 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1259/2490] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:55:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:55:32.366007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d9cea-9cb4-47c5-85b7-b90b8e4841fb service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:32.375502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d9cea-9cb4-47c5-85b7-b90b8e4841fb service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:32.379397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:32.380050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:32.380359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:32.380640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:32.382436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:32.396859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:32.398357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:32.410630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1232/2491] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:55:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:55:39.651023 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab474f0-fed3-4cb2-b59d-c6935bdee278 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:39.660787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab474f0-fed3-4cb2-b59d-c6935bdee278 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:39.664411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf881e-abaf-4da2-af4d-2ddddf96ee08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:39.665047 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf881e-abaf-4da2-af4d-2ddddf96ee08 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:39.665336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf881e-abaf-4da2-af4d-2ddddf96ee08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:39.665617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf881e-abaf-4da2-af4d-2ddddf96ee08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:39.667363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-98bf881e-abaf-4da2-af4d-2ddddf96ee08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:39.731199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf881e-abaf-4da2-af4d-2ddddf96ee08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:39.732704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf881e-abaf-4da2-af4d-2ddddf96ee08 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:39.742502 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1260/2492] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:55:42.405185 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=12 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.236578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.238442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:43.253326 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb175c-b164-467d-9fa8-1de5b834e50b service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.258278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.259154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.259436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.259711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] PATH_INFO: `/v3/users/0e90497b6d9c4a789f6b31680e069087` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.275714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e90497b6d9c4a789f6b31680e069087)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:43.277701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:43.437972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e90497b6d9c4a789f6b31680e069087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:43.438646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e90497b6d9c4a789f6b31680e069087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:43.445524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e90497b6d9c4a789f6b31680e069087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:43.458372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e90497b6d9c4a789f6b31680e069087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:43.543605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-5ea0b591-f1f9-4fd9-ac3f-b8563e7c3f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e90497b6d9c4a789f6b31680e069087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:43.550145 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1233/2493] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:55:43 2022] DELETE /identity/v3/users/0e90497b6d9c4a789f6b31680e069087 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:43.790915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf881e-abaf-4da2-af4d-2ddddf96ee08 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:43.804629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf881e-abaf-4da2-af4d-2ddddf96ee08 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:43.862225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:43.863067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:43.863353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:43.863631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] PATH_INFO: `/v3/projects/c14a96662507495b84670e2f62f90f59` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:43.874967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14a96662507495b84670e2f62f90f59)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:43.876939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.014986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14a96662507495b84670e2f62f90f59', 'request_id': 'req-f65057b1-e043-4710-aec1-86d9ba3f5a8a'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:44.020889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14a96662507495b84670e2f62f90f59', 'request_id': 'req-f65057b1-e043-4710-aec1-86d9ba3f5a8a'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:44.081732 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14a96662507495b84670e2f62f90f59', 'request_id': 'req-f65057b1-e043-4710-aec1-86d9ba3f5a8a'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:44.095445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] The token cache is being invalidate because project c14a96662507495b84670e2f62f90f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:55:44.095745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:44.096429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f65057b1-e043-4710-aec1-86d9ba3f5a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:44.098258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1261/2494] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:55:43 2022] DELETE /identity/v3/projects/c14a96662507495b84670e2f62f90f59 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:44.103060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df0c6f-6d8f-4403-a7ae-a9e35b0d113d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.103350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df0c6f-6d8f-4403-a7ae-a9e35b0d113d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.103630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df0c6f-6d8f-4403-a7ae-a9e35b0d113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.123383 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a3df0c6f-6d8f-4403-a7ae-a9e35b0d113d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:44.125507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a3df0c6f-6d8f-4403-a7ae-a9e35b0d113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:44.184282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1234/2495] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:44.192975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4d722-c834-4675-b8b0-ee81f81d3c5e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.193340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4d722-c834-4675-b8b0-ee81f81d3c5e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.193862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4d722-c834-4675-b8b0-ee81f81d3c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.200428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.213070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d0e4d722-c834-4675-b8b0-ee81f81d3c5e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:44.214323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d0e4d722-c834-4675-b8b0-ee81f81d3c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:44.223187 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1262/2496] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:44.227470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df0c6f-6d8f-4403-a7ae-a9e35b0d113d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.237920 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df0c6f-6d8f-4403-a7ae-a9e35b0d113d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.242664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423e764-85c9-4334-94cc-195253b6415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.244064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423e764-85c9-4334-94cc-195253b6415d admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.244064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423e764-85c9-4334-94cc-195253b6415d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.244064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423e764-85c9-4334-94cc-195253b6415d admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.244751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423e764-85c9-4334-94cc-195253b6415d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:44.245063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423e764-85c9-4334-94cc-195253b6415d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.246680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423e764-85c9-4334-94cc-195253b6415d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.259165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1235/2497] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:44.263368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4d722-c834-4675-b8b0-ee81f81d3c5e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.273487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4d722-c834-4675-b8b0-ee81f81d3c5e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.278347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6649df-bbdf-4809-9bc5-bed1d28884c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.279002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6649df-bbdf-4809-9bc5-bed1d28884c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.279288 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6649df-bbdf-4809-9bc5-bed1d28884c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.279568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6649df-bbdf-4809-9bc5-bed1d28884c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.280403 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6649df-bbdf-4809-9bc5-bed1d28884c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.282360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6649df-bbdf-4809-9bc5-bed1d28884c9 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.402224 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1263/2498] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:55:44 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:44.407387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423e764-85c9-4334-94cc-195253b6415d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.417751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423e764-85c9-4334-94cc-195253b6415d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.465307 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:44.477938 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898aeace-23b0-4223-b729-b8a363c54226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.478608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898aeace-23b0-4223-b729-b8a363c54226 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.479006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898aeace-23b0-4223-b729-b8a363c54226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.479223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898aeace-23b0-4223-b729-b8a363c54226 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.479903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898aeace-23b0-4223-b729-b8a363c54226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.481863 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898aeace-23b0-4223-b729-b8a363c54226 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.607642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1236/2499] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:55:44 2022] POST /identity/v3/users => generated 302 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:55:44.613149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6649df-bbdf-4809-9bc5-bed1d28884c9 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.623550 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6649df-bbdf-4809-9bc5-bed1d28884c9 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.629219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f615c0-889e-4534-b61e-d14664322fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.629946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f615c0-889e-4534-b61e-d14664322fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.630233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f615c0-889e-4534-b61e-d14664322fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.630568 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f615c0-889e-4534-b61e-d14664322fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.631293 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f615c0-889e-4534-b61e-d14664322fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.632995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f615c0-889e-4534-b61e-d14664322fe4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.643651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1264/2500] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:55:44.647919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898aeace-23b0-4223-b729-b8a363c54226 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.659347 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898aeace-23b0-4223-b729-b8a363c54226 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.664016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c58cd-d7e9-421c-975a-9dfd88dbbcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.664735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c58cd-d7e9-421c-975a-9dfd88dbbcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.668089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c58cd-d7e9-421c-975a-9dfd88dbbcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.668089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c58cd-d7e9-421c-975a-9dfd88dbbcd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.668089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c58cd-d7e9-421c-975a-9dfd88dbbcd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.668089 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c58cd-d7e9-421c-975a-9dfd88dbbcd4 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.679216 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1237/2501] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:55:44.683409 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f615c0-889e-4534-b61e-d14664322fe4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.693514 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f615c0-889e-4534-b61e-d14664322fe4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.699394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dc275-0927-4de0-8862-fc815c152285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.699394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dc275-0927-4de0-8862-fc815c152285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.699394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dc275-0927-4de0-8862-fc815c152285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.699717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dc275-0927-4de0-8862-fc815c152285 admin admin] PATH_INFO: `/v3/projects/ebd32fc9d2d64461bb6298d0db15b9c0/users/a03ad6f47b9c4706b3065699dd526b32/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.714889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dc275-0927-4de0-8862-fc815c152285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd32fc9d2d64461bb6298d0db15b9c0, user_id=a03ad6f47b9c4706b3065699dd526b32, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.718390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dc275-0927-4de0-8862-fc815c152285 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:44.773296 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1265/2502] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:55:44 2022] PUT /identity/v3/projects/ebd32fc9d2d64461bb6298d0db15b9c0/users/a03ad6f47b9c4706b3065699dd526b32/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:44.784856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ade74-fb82-455d-ac21-57ad6b690ceb None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.785149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ade74-fb82-455d-ac21-57ad6b690ceb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.785433 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ade74-fb82-455d-ac21-57ad6b690ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.812200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c70ade74-fb82-455d-ac21-57ad6b690ceb None None] MFA Rules not processed for user `a03ad6f47b9c4706b3065699dd526b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:44.813444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c70ade74-fb82-455d-ac21-57ad6b690ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:44.878377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1238/2503] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:44.882751 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dc275-0927-4de0-8862-fc815c152285 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:44.942178 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dc275-0927-4de0-8862-fc815c152285 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:44.946692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5a59-d4d9-4311-8b7f-7db358e6f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:44.947332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5a59-d4d9-4311-8b7f-7db358e6f78e admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:44.947612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5a59-d4d9-4311-8b7f-7db358e6f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:44.947887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5a59-d4d9-4311-8b7f-7db358e6f78e admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:44.948588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5a59-d4d9-4311-8b7f-7db358e6f78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:44.950511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5a59-d4d9-4311-8b7f-7db358e6f78e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.054797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1266/2504] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:55:44 2022] POST /identity/v3/projects => generated 403 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:45.058837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ade74-fb82-455d-ac21-57ad6b690ceb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.070611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ade74-fb82-455d-ac21-57ad6b690ceb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.134549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25ef9b-48b6-4927-821f-94d69d68c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.135222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25ef9b-48b6-4927-821f-94d69d68c160 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.135508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25ef9b-48b6-4927-821f-94d69d68c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.135786 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25ef9b-48b6-4927-821f-94d69d68c160 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.136518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25ef9b-48b6-4927-821f-94d69d68c160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.138535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25ef9b-48b6-4927-821f-94d69d68c160 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.254141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1239/2505] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:55:45 2022] POST /identity/v3/users => generated 308 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:45.258084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5a59-d4d9-4311-8b7f-7db358e6f78e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.269611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5a59-d4d9-4311-8b7f-7db358e6f78e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.274178 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802bde-e895-453e-9ee0-d2a49adbe43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.274832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802bde-e895-453e-9ee0-d2a49adbe43a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.275122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802bde-e895-453e-9ee0-d2a49adbe43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.275403 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802bde-e895-453e-9ee0-d2a49adbe43a admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.276137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83802bde-e895-453e-9ee0-d2a49adbe43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.277780 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83802bde-e895-453e-9ee0-d2a49adbe43a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.288842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1267/2506] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:55:45.293029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25ef9b-48b6-4927-821f-94d69d68c160 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.303198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25ef9b-48b6-4927-821f-94d69d68c160 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.307827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebe286-32f7-4cf3-a315-17af1a2106bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.308732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebe286-32f7-4cf3-a315-17af1a2106bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.309020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebe286-32f7-4cf3-a315-17af1a2106bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.309300 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebe286-32f7-4cf3-a315-17af1a2106bf admin admin] PATH_INFO: `/v3/projects/9de5915ba6d54e24825c5917d42ec8d9/users/ea42504188d144f3bd2ccc1b083db354/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.324377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebe286-32f7-4cf3-a315-17af1a2106bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de5915ba6d54e24825c5917d42ec8d9, user_id=ea42504188d144f3bd2ccc1b083db354, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.327694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebe286-32f7-4cf3-a315-17af1a2106bf admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.390398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1240/2507] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:55:45 2022] PUT /identity/v3/projects/9de5915ba6d54e24825c5917d42ec8d9/users/ea42504188d144f3bd2ccc1b083db354/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:45.398167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802bde-e895-453e-9ee0-d2a49adbe43a admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.408899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802bde-e895-453e-9ee0-d2a49adbe43a admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.466731 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e52b03-8b92-49c2-a0e8-de100454f39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.467391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52b03-8b92-49c2-a0e8-de100454f39b admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.467763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52b03-8b92-49c2-a0e8-de100454f39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.468569 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52b03-8b92-49c2-a0e8-de100454f39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.469300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e52b03-8b92-49c2-a0e8-de100454f39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.470914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e52b03-8b92-49c2-a0e8-de100454f39b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.480666 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1268/2508] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:55:45.485726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebe286-32f7-4cf3-a315-17af1a2106bf admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.496410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebe286-32f7-4cf3-a315-17af1a2106bf admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.501931 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545f04-aefd-4f44-b626-d40d1556bf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.502833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545f04-aefd-4f44-b626-d40d1556bf89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.503114 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545f04-aefd-4f44-b626-d40d1556bf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.503385 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545f04-aefd-4f44-b626-d40d1556bf89 admin admin] PATH_INFO: `/v3/projects/9de5915ba6d54e24825c5917d42ec8d9/users/ea42504188d144f3bd2ccc1b083db354/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.505408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545f04-aefd-4f44-b626-d40d1556bf89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de5915ba6d54e24825c5917d42ec8d9, user_id=ea42504188d144f3bd2ccc1b083db354, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.508000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545f04-aefd-4f44-b626-d40d1556bf89 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.518322 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1241/2509] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:55:45 2022] PUT /identity/v3/projects/9de5915ba6d54e24825c5917d42ec8d9/users/ea42504188d144f3bd2ccc1b083db354/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:45.528436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f9cbc-cc7e-4aa2-827a-b19c47e442a4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.528730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f9cbc-cc7e-4aa2-827a-b19c47e442a4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.529009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f9cbc-cc7e-4aa2-827a-b19c47e442a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.547545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.556767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-138f9cbc-cc7e-4aa2-827a-b19c47e442a4 None None] MFA Rules not processed for user `ea42504188d144f3bd2ccc1b083db354`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:45.558122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-138f9cbc-cc7e-4aa2-827a-b19c47e442a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:45.627004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1269/2510] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:45.637948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545f04-aefd-4f44-b626-d40d1556bf89 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.639756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1d545f04-aefd-4f44-b626-d40d1556bf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:45.650817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:45.699132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545f04-aefd-4f44-b626-d40d1556bf89 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.703082 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacfba6-b230-4732-9f3b-0896344f3256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.703740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfba6-b230-4732-9f3b-0896344f3256 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.704228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfba6-b230-4732-9f3b-0896344f3256 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.704744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfba6-b230-4732-9f3b-0896344f3256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.714458 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacfba6-b230-4732-9f3b-0896344f3256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.715877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacfba6-b230-4732-9f3b-0896344f3256 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:45.725209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1242/2511] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:55:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:55:45.853562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f9cbc-cc7e-4aa2-827a-b19c47e442a4 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:45.915678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f9cbc-cc7e-4aa2-827a-b19c47e442a4 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:45.920234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:45.921935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:45.922218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:45.922494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] PATH_INFO: `/v3/users/a03ad6f47b9c4706b3065699dd526b32` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:45.923697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03ad6f47b9c4706b3065699dd526b32)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:45.925676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.101975 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03ad6f47b9c4706b3065699dd526b32'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:46.154735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03ad6f47b9c4706b3065699dd526b32'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:46.155845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03ad6f47b9c4706b3065699dd526b32'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:46.156573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03ad6f47b9c4706b3065699dd526b32'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:46.163677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03ad6f47b9c4706b3065699dd526b32'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:46.181191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1270/2512] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:55:45 2022] DELETE /identity/v3/users/a03ad6f47b9c4706b3065699dd526b32 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:46.185738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c3d71-6e83-4ae9-b1cc-476ed323a54f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.187867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c3d71-6e83-4ae9-b1cc-476ed323a54f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.187867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c3d71-6e83-4ae9-b1cc-476ed323a54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.204345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-f44c3d71-6e83-4ae9-b1cc-476ed323a54f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:46.205791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f44c3d71-6e83-4ae9-b1cc-476ed323a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:46.267173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1243/2513] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:46.276994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.278344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:46.293239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:46.336655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea741251-1be3-4ad2-833f-4efec82b82aa admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.340451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9997a-cc99-4443-9539-dfb37ee35099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.341104 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9997a-cc99-4443-9539-dfb37ee35099 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.341389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9997a-cc99-4443-9539-dfb37ee35099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.341663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9997a-cc99-4443-9539-dfb37ee35099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.351890 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9997a-cc99-4443-9539-dfb37ee35099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.353453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9997a-cc99-4443-9539-dfb37ee35099 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.363111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1271/2514] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:55:46.807737 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c3d71-6e83-4ae9-b1cc-476ed323a54f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:46.809229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f44c3d71-6e83-4ae9-b1cc-476ed323a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:46.822549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c3d71-6e83-4ae9-b1cc-476ed323a54f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:46.827171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:46.828224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:46.828536 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:46.828812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] PATH_INFO: `/v3/projects/ebd32fc9d2d64461bb6298d0db15b9c0` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:46.830014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd32fc9d2d64461bb6298d0db15b9c0)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:46.831952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:46.938080 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd32fc9d2d64461bb6298d0db15b9c0', 'request_id': 'req-64339bc5-2a1e-453d-b753-5baa25d70b25'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:46.990044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd32fc9d2d64461bb6298d0db15b9c0', 'request_id': 'req-64339bc5-2a1e-453d-b753-5baa25d70b25'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:46.996560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd32fc9d2d64461bb6298d0db15b9c0', 'request_id': 'req-64339bc5-2a1e-453d-b753-5baa25d70b25'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:47.007099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] The token cache is being invalidate because project ebd32fc9d2d64461bb6298d0db15b9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:55:47.007386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:47.008014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:47.009617 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1244/2515] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:55:46 2022] DELETE /identity/v3/projects/ebd32fc9d2d64461bb6298d0db15b9c0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:47.013589 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9997a-cc99-4443-9539-dfb37ee35099 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.024151 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9997a-cc99-4443-9539-dfb37ee35099 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.080622 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.081259 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.081548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.081829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] PATH_INFO: `/v3/users/ea42504188d144f3bd2ccc1b083db354` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.083303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea42504188d144f3bd2ccc1b083db354)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.085384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.296358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea42504188d144f3bd2ccc1b083db354'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:47.344763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea42504188d144f3bd2ccc1b083db354'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:47.345334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea42504188d144f3bd2ccc1b083db354'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:47.345939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea42504188d144f3bd2ccc1b083db354'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:47.353063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-1a56e198-ceea-432e-aed3-f49c66dbaef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea42504188d144f3bd2ccc1b083db354'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:47.370613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1272/2516] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:55:47 2022] DELETE /identity/v3/users/ea42504188d144f3bd2ccc1b083db354 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:47.774190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:47.775805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:47.789466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339bc5-2a1e-453d-b753-5baa25d70b25 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:47.824351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:47.848396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:47.849210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:47.849489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:47.849765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] PATH_INFO: `/v3/projects/9de5915ba6d54e24825c5917d42ec8d9` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:47.850939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de5915ba6d54e24825c5917d42ec8d9)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:47.852960 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:47.945502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de5915ba6d54e24825c5917d42ec8d9', 'request_id': 'req-26087881-4e2a-4904-94b3-868d370f4362'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:48.001579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de5915ba6d54e24825c5917d42ec8d9', 'request_id': 'req-26087881-4e2a-4904-94b3-868d370f4362'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:48.007967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de5915ba6d54e24825c5917d42ec8d9', 'request_id': 'req-26087881-4e2a-4904-94b3-868d370f4362'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:48.018701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] The token cache is being invalidate because project 9de5915ba6d54e24825c5917d42ec8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:55:48.019053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:48.019683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-26087881-4e2a-4904-94b3-868d370f4362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:55:48.021266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1245/2517] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:55:47 2022] DELETE /identity/v3/projects/9de5915ba6d54e24825c5917d42ec8d9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:48.027123 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3861b-0933-46e2-87fd-249021389ce4 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.031753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3861b-0933-46e2-87fd-249021389ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.031753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3861b-0933-46e2-87fd-249021389ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.047384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d0a3861b-0933-46e2-87fd-249021389ce4 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:48.048816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d0a3861b-0933-46e2-87fd-249021389ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:48.078692 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.107341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1273/2518] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:48.115670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815b91-be75-4719-858a-f44ff75fcdee None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.117804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815b91-be75-4719-858a-f44ff75fcdee None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.117804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815b91-be75-4719-858a-f44ff75fcdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.134941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6f815b91-be75-4719-858a-f44ff75fcdee None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:48.136012 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6f815b91-be75-4719-858a-f44ff75fcdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:48.144591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1246/2519] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:48.148957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3861b-0933-46e2-87fd-249021389ce4 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.159314 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3861b-0933-46e2-87fd-249021389ce4 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.164239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232c790-e078-4b96-87b0-f8e1e8ed3030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.164919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232c790-e078-4b96-87b0-f8e1e8ed3030 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.165327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232c790-e078-4b96-87b0-f8e1e8ed3030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.165609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232c790-e078-4b96-87b0-f8e1e8ed3030 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.166333 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232c790-e078-4b96-87b0-f8e1e8ed3030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:55:48.166630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232c790-e078-4b96-87b0-f8e1e8ed3030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.168222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232c790-e078-4b96-87b0-f8e1e8ed3030 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.182906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1274/2520] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:55:48.185053 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815b91-be75-4719-858a-f44ff75fcdee None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.194611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815b91-be75-4719-858a-f44ff75fcdee None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.199392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad389070-a45a-4cb2-9c62-32aaa25fc312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.200030 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad389070-a45a-4cb2-9c62-32aaa25fc312 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.200412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad389070-a45a-4cb2-9c62-32aaa25fc312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.200722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad389070-a45a-4cb2-9c62-32aaa25fc312 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.201433 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad389070-a45a-4cb2-9c62-32aaa25fc312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.206535 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad389070-a45a-4cb2-9c62-32aaa25fc312 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.284711 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1247/2521] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:55:48 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:48.288174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232c790-e078-4b96-87b0-f8e1e8ed3030 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.299118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232c790-e078-4b96-87b0-f8e1e8ed3030 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.355943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7251e9-173e-47c2-80f8-15eb6198420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.356680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7251e9-173e-47c2-80f8-15eb6198420e admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.356968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7251e9-173e-47c2-80f8-15eb6198420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.357251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7251e9-173e-47c2-80f8-15eb6198420e admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.357939 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7251e9-173e-47c2-80f8-15eb6198420e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.359889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7251e9-173e-47c2-80f8-15eb6198420e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.459053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1275/2522] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:55:48 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:48.462918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad389070-a45a-4cb2-9c62-32aaa25fc312 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.474488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad389070-a45a-4cb2-9c62-32aaa25fc312 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.479207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93a9f0-35fa-4d83-b3da-009ce78330e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.479863 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93a9f0-35fa-4d83-b3da-009ce78330e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.480147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93a9f0-35fa-4d83-b3da-009ce78330e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.480469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93a9f0-35fa-4d83-b3da-009ce78330e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.481219 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93a9f0-35fa-4d83-b3da-009ce78330e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.482817 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93a9f0-35fa-4d83-b3da-009ce78330e8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.493524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1248/2523] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:55:48.497498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7251e9-173e-47c2-80f8-15eb6198420e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.507900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7251e9-173e-47c2-80f8-15eb6198420e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.512610 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87e929-5e00-4efd-9c59-1005ee6e63cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.513264 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87e929-5e00-4efd-9c59-1005ee6e63cb admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.513546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87e929-5e00-4efd-9c59-1005ee6e63cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.513822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87e929-5e00-4efd-9c59-1005ee6e63cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.514566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87e929-5e00-4efd-9c59-1005ee6e63cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.516197 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87e929-5e00-4efd-9c59-1005ee6e63cb admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.527190 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1276/2524] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:55:48.531255 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93a9f0-35fa-4d83-b3da-009ce78330e8 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.542054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93a9f0-35fa-4d83-b3da-009ce78330e8 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.546638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d63e8f-d6a8-411f-9cda-9509328e80ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.547509 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d63e8f-d6a8-411f-9cda-9509328e80ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.547795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d63e8f-d6a8-411f-9cda-9509328e80ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.548155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d63e8f-d6a8-411f-9cda-9509328e80ae admin admin] PATH_INFO: `/v3/projects/1cf7d9e91d4440ecb2c25c1824c739e8/users/352eace1d62b4c89935fac94e95c1c12/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.562677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d63e8f-d6a8-411f-9cda-9509328e80ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf7d9e91d4440ecb2c25c1824c739e8, user_id=352eace1d62b4c89935fac94e95c1c12, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.565731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d63e8f-d6a8-411f-9cda-9509328e80ae admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.641247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1249/2525] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:55:48 2022] PUT /identity/v3/projects/1cf7d9e91d4440ecb2c25c1824c739e8/users/352eace1d62b4c89935fac94e95c1c12/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:48.653483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773e3b5-ec95-4b09-b638-5fe7a7f56792 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.653777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773e3b5-ec95-4b09-b638-5fe7a7f56792 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.654062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773e3b5-ec95-4b09-b638-5fe7a7f56792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.683149 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5773e3b5-ec95-4b09-b638-5fe7a7f56792 None None] MFA Rules not processed for user `352eace1d62b4c89935fac94e95c1c12`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:48.684400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5773e3b5-ec95-4b09-b638-5fe7a7f56792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:48.748074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1277/2526] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:48.753113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d63e8f-d6a8-411f-9cda-9509328e80ae admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.821265 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d63e8f-d6a8-411f-9cda-9509328e80ae admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.826088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc152ef-3a42-49c1-b2da-115ee01ce701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:48.826754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc152ef-3a42-49c1-b2da-115ee01ce701 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:48.827040 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc152ef-3a42-49c1-b2da-115ee01ce701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:48.827318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc152ef-3a42-49c1-b2da-115ee01ce701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:48.828050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc152ef-3a42-49c1-b2da-115ee01ce701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:48.831218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc152ef-3a42-49c1-b2da-115ee01ce701 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:48.835534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.927878 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1250/2527] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:55:48 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:55:48.931926 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773e3b5-ec95-4b09-b638-5fe7a7f56792 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:48.943114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773e3b5-ec95-4b09-b638-5fe7a7f56792 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:48.972051 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:48.999426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e341f6e-2e64-4443-b4d0-d70456095a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.000032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e341f6e-2e64-4443-b4d0-d70456095a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.000342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e341f6e-2e64-4443-b4d0-d70456095a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.000625 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e341f6e-2e64-4443-b4d0-d70456095a9e admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.002390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e341f6e-2e64-4443-b4d0-d70456095a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.004381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e341f6e-2e64-4443-b4d0-d70456095a9e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.120746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1278/2528] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:55:48 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:49.124746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc152ef-3a42-49c1-b2da-115ee01ce701 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.136016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc152ef-3a42-49c1-b2da-115ee01ce701 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.140603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771d851-3b3d-41ce-944a-325f9829b04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.141260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771d851-3b3d-41ce-944a-325f9829b04a admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.141546 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771d851-3b3d-41ce-944a-325f9829b04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.142805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771d851-3b3d-41ce-944a-325f9829b04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.143539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771d851-3b3d-41ce-944a-325f9829b04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.145176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771d851-3b3d-41ce-944a-325f9829b04a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.156635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1251/2529] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:55:49.160576 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e341f6e-2e64-4443-b4d0-d70456095a9e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.170472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e341f6e-2e64-4443-b4d0-d70456095a9e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.175806 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdf874-0ea0-4391-842c-4afc20ae3f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.176506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf874-0ea0-4391-842c-4afc20ae3f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.176794 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf874-0ea0-4391-842c-4afc20ae3f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.177072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf874-0ea0-4391-842c-4afc20ae3f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.177787 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdf874-0ea0-4391-842c-4afc20ae3f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.179388 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdf874-0ea0-4391-842c-4afc20ae3f6b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.190243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1279/2530] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:55:49.194653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771d851-3b3d-41ce-944a-325f9829b04a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.204999 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771d851-3b3d-41ce-944a-325f9829b04a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.210119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c90935-0aea-4ccb-9114-eb8d14cf9230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.211057 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c90935-0aea-4ccb-9114-eb8d14cf9230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.211329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c90935-0aea-4ccb-9114-eb8d14cf9230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.215955 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c90935-0aea-4ccb-9114-eb8d14cf9230 admin admin] PATH_INFO: `/v3/projects/fa6046a09a8c44269fda2bce29dd6ff3/users/7632b80e514d481ea585483eca6e23f7/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.227005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c90935-0aea-4ccb-9114-eb8d14cf9230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6046a09a8c44269fda2bce29dd6ff3, user_id=7632b80e514d481ea585483eca6e23f7, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.229717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c90935-0aea-4ccb-9114-eb8d14cf9230 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.281462 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1252/2531] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:55:49 2022] PUT /identity/v3/projects/fa6046a09a8c44269fda2bce29dd6ff3/users/7632b80e514d481ea585483eca6e23f7/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:49.291942 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde60f4-8e3f-4408-939b-2bc4c6c7cb97 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.292230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde60f4-8e3f-4408-939b-2bc4c6c7cb97 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.292555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde60f4-8e3f-4408-939b-2bc4c6c7cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.320024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-3cde60f4-8e3f-4408-939b-2bc4c6c7cb97 None None] MFA Rules not processed for user `7632b80e514d481ea585483eca6e23f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:49.321325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3cde60f4-8e3f-4408-939b-2bc4c6c7cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:49.384221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1280/2532] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:49.388839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c90935-0aea-4ccb-9114-eb8d14cf9230 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.450151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c90935-0aea-4ccb-9114-eb8d14cf9230 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.454839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05ad5a-b9d0-4ec0-91f0-ffae2307bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.455485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05ad5a-b9d0-4ec0-91f0-ffae2307bdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.455770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05ad5a-b9d0-4ec0-91f0-ffae2307bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.456048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05ad5a-b9d0-4ec0-91f0-ffae2307bdb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.456763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05ad5a-b9d0-4ec0-91f0-ffae2307bdb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.458929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05ad5a-b9d0-4ec0-91f0-ffae2307bdb3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.522160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1253/2533] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:55:49 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:49.526458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde60f4-8e3f-4408-939b-2bc4c6c7cb97 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.539933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde60f4-8e3f-4408-939b-2bc4c6c7cb97 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.591544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92e49-1ddc-4547-8e2f-6d92be9c5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.592229 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92e49-1ddc-4547-8e2f-6d92be9c5751 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.592537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92e49-1ddc-4547-8e2f-6d92be9c5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.592810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92e49-1ddc-4547-8e2f-6d92be9c5751 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.593487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d92e49-1ddc-4547-8e2f-6d92be9c5751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.595905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d92e49-1ddc-4547-8e2f-6d92be9c5751 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.664812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1281/2534] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:55:49 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:55:49.668880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05ad5a-b9d0-4ec0-91f0-ffae2307bdb3 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.680281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05ad5a-b9d0-4ec0-91f0-ffae2307bdb3 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.684928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9d77-2d04-492d-b5fa-0441ef806c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.685601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9d77-2d04-492d-b5fa-0441ef806c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.685887 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9d77-2d04-492d-b5fa-0441ef806c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.686166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9d77-2d04-492d-b5fa-0441ef806c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.686889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a9d77-2d04-492d-b5fa-0441ef806c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.688537 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a9d77-2d04-492d-b5fa-0441ef806c2a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.699501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1254/2535] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:55:49.703556 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92e49-1ddc-4547-8e2f-6d92be9c5751 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.714253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92e49-1ddc-4547-8e2f-6d92be9c5751 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.718906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec146fa-89e3-49b6-b8b0-0c90daea2a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.720351 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec146fa-89e3-49b6-b8b0-0c90daea2a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.721179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec146fa-89e3-49b6-b8b0-0c90daea2a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.721464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec146fa-89e3-49b6-b8b0-0c90daea2a56 admin admin] PATH_INFO: `/v3/projects/0a9502cba43e4af7b9de04c65db55207/users/a043f89fbbc64b2182736ad87dfc1e68/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.737481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec146fa-89e3-49b6-b8b0-0c90daea2a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9502cba43e4af7b9de04c65db55207, user_id=a043f89fbbc64b2182736ad87dfc1e68, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.740150 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec146fa-89e3-49b6-b8b0-0c90daea2a56 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.824228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1282/2536] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:55:49 2022] PUT /identity/v3/projects/0a9502cba43e4af7b9de04c65db55207/users/a043f89fbbc64b2182736ad87dfc1e68/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:49.828180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9d77-2d04-492d-b5fa-0441ef806c2a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.838721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9d77-2d04-492d-b5fa-0441ef806c2a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.896526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b20ef-579b-49a4-bf43-6284ec187cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.897220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b20ef-579b-49a4-bf43-6284ec187cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.897498 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b20ef-579b-49a4-bf43-6284ec187cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.897773 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b20ef-579b-49a4-bf43-6284ec187cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.898579 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b20ef-579b-49a4-bf43-6284ec187cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.900060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b20ef-579b-49a4-bf43-6284ec187cd2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.910119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1255/2537] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:55:49.914269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec146fa-89e3-49b6-b8b0-0c90daea2a56 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:49.921020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:49.924944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec146fa-89e3-49b6-b8b0-0c90daea2a56 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:49.929675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa7a75-5101-4ed9-96d0-5f8d36ca5092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:49.930547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa7a75-5101-4ed9-96d0-5f8d36ca5092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.932212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa7a75-5101-4ed9-96d0-5f8d36ca5092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.932212 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa7a75-5101-4ed9-96d0-5f8d36ca5092 admin admin] PATH_INFO: `/v3/projects/0a9502cba43e4af7b9de04c65db55207/users/a043f89fbbc64b2182736ad87dfc1e68/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.933277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa7a75-5101-4ed9-96d0-5f8d36ca5092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9502cba43e4af7b9de04c65db55207, user_id=a043f89fbbc64b2182736ad87dfc1e68, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:49.936078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa7a75-5101-4ed9-96d0-5f8d36ca5092 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:49.946583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1283/2538] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:55:49 2022] PUT /identity/v3/projects/0a9502cba43e4af7b9de04c65db55207/users/a043f89fbbc64b2182736ad87dfc1e68/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:55:49.957560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f4925-01c6-4143-ac64-08460c58e4fb None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:49.957855 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f4925-01c6-4143-ac64-08460c58e4fb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:49.958395 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f4925-01c6-4143-ac64-08460c58e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:49.985263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-e32f4925-01c6-4143-ac64-08460c58e4fb None None] MFA Rules not processed for user `a043f89fbbc64b2182736ad87dfc1e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:55:49.986474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e32f4925-01c6-4143-ac64-08460c58e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:49.995658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:50.054038 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1256/2539] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:55:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:55:50.065361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa7a75-5101-4ed9-96d0-5f8d36ca5092 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:50.067014 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e5fa7a75-5101-4ed9-96d0-5f8d36ca5092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:50.123986 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa7a75-5101-4ed9-96d0-5f8d36ca5092 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:50.128006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f59559-5677-4895-a429-b3e1980910f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:50.128670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f59559-5677-4895-a429-b3e1980910f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:50.128963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f59559-5677-4895-a429-b3e1980910f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:50.129241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f59559-5677-4895-a429-b3e1980910f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:50.138319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f59559-5677-4895-a429-b3e1980910f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:50.139757 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f59559-5677-4895-a429-b3e1980910f2 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:50.149778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1284/2540] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:55:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:55:51.264610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f4925-01c6-4143-ac64-08460c58e4fb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:51.274548 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f4925-01c6-4143-ac64-08460c58e4fb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:51.278174 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffd23d-94a7-42df-973f-6aefd759b73e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:51.278821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffd23d-94a7-42df-973f-6aefd759b73e service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:51.279108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffd23d-94a7-42df-973f-6aefd759b73e service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:51.279386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffd23d-94a7-42df-973f-6aefd759b73e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:51.339732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffd23d-94a7-42df-973f-6aefd759b73e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:51.341245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffd23d-94a7-42df-973f-6aefd759b73e service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:51.355885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1257/2541] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:55:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:55:56.279531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f59559-5677-4895-a429-b3e1980910f2 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:55:56.281085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e4f59559-5677-4895-a429-b3e1980910f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:55:56.293130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f59559-5677-4895-a429-b3e1980910f2 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:55:56.297106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786f9a0-2825-444e-bad9-01f670ccd332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:55:56.297769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f9a0-2825-444e-bad9-01f670ccd332 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:55:56.303626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f9a0-2825-444e-bad9-01f670ccd332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:55:56.303626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f9a0-2825-444e-bad9-01f670ccd332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:55:56.358805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786f9a0-2825-444e-bad9-01f670ccd332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:55:56.360361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786f9a0-2825-444e-bad9-01f670ccd332 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:55:56.370479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1285/2542] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:55:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:00.746021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffd23d-94a7-42df-973f-6aefd759b73e service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:00.809032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffd23d-94a7-42df-973f-6aefd759b73e service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:00.813505 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:00.814369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:00.814652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:00.814929 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] PATH_INFO: `/v3/users/352eace1d62b4c89935fac94e95c1c12` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:00.816116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=352eace1d62b4c89935fac94e95c1c12)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:00.818069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:00.965683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352eace1d62b4c89935fac94e95c1c12'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:00.966759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352eace1d62b4c89935fac94e95c1c12'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:00.967680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:00.975023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352eace1d62b4c89935fac94e95c1c12'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:00.994037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352eace1d62b4c89935fac94e95c1c12'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:01.086346 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352eace1d62b4c89935fac94e95c1c12'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:01.092896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1258/2543] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:00 2022] DELETE /identity/v3/users/352eace1d62b4c89935fac94e95c1c12 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:01.098097 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5430-b492-4836-b353-c971aa58ac7c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.098590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5430-b492-4836-b353-c971aa58ac7c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.098697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5430-b492-4836-b353-c971aa58ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.115738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-0a6e5430-b492-4836-b353-c971aa58ac7c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:01.119068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0a6e5430-b492-4836-b353-c971aa58ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:01.177602 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1286/2544] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:01.187329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.191146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:01.256017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae425b-206a-4bfc-a7c5-f326012abd7e admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.259820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729aa9-4cb6-4dcd-a38c-e1133c562923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.260532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729aa9-4cb6-4dcd-a38c-e1133c562923 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.260815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729aa9-4cb6-4dcd-a38c-e1133c562923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.261091 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729aa9-4cb6-4dcd-a38c-e1133c562923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.271329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a729aa9-4cb6-4dcd-a38c-e1133c562923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.272807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a729aa9-4cb6-4dcd-a38c-e1133c562923 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.282155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1259/2545] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:01.671600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5430-b492-4836-b353-c971aa58ac7c None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.673223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0a6e5430-b492-4836-b353-c971aa58ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:01.686541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5430-b492-4836-b353-c971aa58ac7c None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:01.692634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:01.693508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:01.693799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:01.694141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] PATH_INFO: `/v3/projects/1cf7d9e91d4440ecb2c25c1824c739e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:01.695341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf7d9e91d4440ecb2c25c1824c739e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:01.697379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:01.826660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:01.842153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf7d9e91d4440ecb2c25c1824c739e8', 'request_id': 'req-884f839d-40ac-4dc8-88c4-b2168026a843'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:01.848218 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf7d9e91d4440ecb2c25c1824c739e8', 'request_id': 'req-884f839d-40ac-4dc8-88c4-b2168026a843'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:01.915384 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf7d9e91d4440ecb2c25c1824c739e8', 'request_id': 'req-884f839d-40ac-4dc8-88c4-b2168026a843'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:01.927801 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] The token cache is being invalidate because project 1cf7d9e91d4440ecb2c25c1824c739e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:01.933241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:01.933241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:01.933241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1287/2546] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:01 2022] DELETE /identity/v3/projects/1cf7d9e91d4440ecb2c25c1824c739e8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:01.934816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729aa9-4cb6-4dcd-a38c-e1133c562923 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:01.944813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729aa9-4cb6-4dcd-a38c-e1133c562923 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.001372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.002159 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.002439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.002712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] PATH_INFO: `/v3/users/7632b80e514d481ea585483eca6e23f7` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.003880 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7632b80e514d481ea585483eca6e23f7)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.005861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.169244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7632b80e514d481ea585483eca6e23f7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.169891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7632b80e514d481ea585483eca6e23f7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.177377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7632b80e514d481ea585483eca6e23f7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.187298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:02.189474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7632b80e514d481ea585483eca6e23f7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.240994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7632b80e514d481ea585483eca6e23f7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.247504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1260/2547] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:01 2022] DELETE /identity/v3/users/7632b80e514d481ea585483eca6e23f7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:02.653644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.653644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:02.665772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f839d-40ac-4dc8-88c4-b2168026a843 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:02.726223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:02.727091 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:02.727379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:02.727653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] PATH_INFO: `/v3/projects/fa6046a09a8c44269fda2bce29dd6ff3` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:02.728893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6046a09a8c44269fda2bce29dd6ff3)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:02.730826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:02.836626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6046a09a8c44269fda2bce29dd6ff3', 'request_id': 'req-e9c41d23-3a08-42cd-9374-2704d691bcd7'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.842125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6046a09a8c44269fda2bce29dd6ff3', 'request_id': 'req-e9c41d23-3a08-42cd-9374-2704d691bcd7'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.909579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6046a09a8c44269fda2bce29dd6ff3', 'request_id': 'req-e9c41d23-3a08-42cd-9374-2704d691bcd7'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.921321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] The token cache is being invalidate because project fa6046a09a8c44269fda2bce29dd6ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:02.921615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.922940 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:02.924534 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1288/2548] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:02 2022] DELETE /identity/v3/projects/fa6046a09a8c44269fda2bce29dd6ff3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:02.928858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:02.930261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:02.943688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170696f-25e4-491b-90f4-689757fdba98 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.000986 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.001860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.002141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.002446 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] PATH_INFO: `/v3/users/a043f89fbbc64b2182736ad87dfc1e68` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.004506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a043f89fbbc64b2182736ad87dfc1e68)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.006474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.192422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a043f89fbbc64b2182736ad87dfc1e68'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:03.193064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a043f89fbbc64b2182736ad87dfc1e68'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:03.201910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a043f89fbbc64b2182736ad87dfc1e68'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:03.214732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a043f89fbbc64b2182736ad87dfc1e68'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:03.316275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a043f89fbbc64b2182736ad87dfc1e68'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:03.322722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1261/2549] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:02 2022] DELETE /identity/v3/users/a043f89fbbc64b2182736ad87dfc1e68 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:03.724963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.726605 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:03.734357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:03.739143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:03.786054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:03.791280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c41d23-3a08-42cd-9374-2704d691bcd7 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.809978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e1919-55a2-4140-9df0-12f5a8ce5f76 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:03.814685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.815795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.816084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.816411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] PATH_INFO: `/v3/projects/0a9502cba43e4af7b9de04c65db55207` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.817643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9502cba43e4af7b9de04c65db55207)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.819743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.828112 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:03.840379 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2291b-7c08-4ce3-b8ad-e4188c195f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:03.841032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2291b-7c08-4ce3-b8ad-e4188c195f8b service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:03.841313 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2291b-7c08-4ce3-b8ad-e4188c195f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:03.841612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2291b-7c08-4ce3-b8ad-e4188c195f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:03.843414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4de2291b-7c08-4ce3-b8ad-e4188c195f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:03.856540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2291b-7c08-4ce3-b8ad-e4188c195f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:03.857966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2291b-7c08-4ce3-b8ad-e4188c195f8b service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:03.867560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1289/2550] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:03.923274 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9502cba43e4af7b9de04c65db55207', 'request_id': 'req-56590edd-aacf-4ed6-be46-b6e593ff1fa4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:03.984150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9502cba43e4af7b9de04c65db55207', 'request_id': 'req-56590edd-aacf-4ed6-be46-b6e593ff1fa4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:03.990941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9502cba43e4af7b9de04c65db55207', 'request_id': 'req-56590edd-aacf-4ed6-be46-b6e593ff1fa4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:04.004078 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] The token cache is being invalidate because project 0a9502cba43e4af7b9de04c65db55207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:04.004396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:04.005063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56590edd-aacf-4ed6-be46-b6e593ff1fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:04.006713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1262/2551] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:03 2022] DELETE /identity/v3/projects/0a9502cba43e4af7b9de04c65db55207 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:04.012943 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bc0cb-bc9b-4cf1-89ee-518b48c9f0c0 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.013233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bc0cb-bc9b-4cf1-89ee-518b48c9f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.013563 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bc0cb-bc9b-4cf1-89ee-518b48c9f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.031945 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-4e9bc0cb-bc9b-4cf1-89ee-518b48c9f0c0 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:04.033164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4e9bc0cb-bc9b-4cf1-89ee-518b48c9f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:04.093707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1290/2552] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:04.103191 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4496b-f7d4-4e0c-bb1e-66063b46dc11 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.103694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4496b-f7d4-4e0c-bb1e-66063b46dc11 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.104045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4496b-f7d4-4e0c-bb1e-66063b46dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.124802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-10b4496b-f7d4-4e0c-bb1e-66063b46dc11 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:04.126070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-10b4496b-f7d4-4e0c-bb1e-66063b46dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:04.134928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1263/2553] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:04.139165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bc0cb-bc9b-4cf1-89ee-518b48c9f0c0 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.150745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bc0cb-bc9b-4cf1-89ee-518b48c9f0c0 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.155444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd4616-687a-4fb5-91d5-baf147c6fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.156106 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4616-687a-4fb5-91d5-baf147c6fccb admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.156421 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4616-687a-4fb5-91d5-baf147c6fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.156703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4616-687a-4fb5-91d5-baf147c6fccb admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.157429 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4616-687a-4fb5-91d5-baf147c6fccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:04.157738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4616-687a-4fb5-91d5-baf147c6fccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.159591 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4616-687a-4fb5-91d5-baf147c6fccb admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.172428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1291/2554] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:04.177132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4496b-f7d4-4e0c-bb1e-66063b46dc11 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.186492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4496b-f7d4-4e0c-bb1e-66063b46dc11 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.193233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c3aa5-be67-4703-a9a2-6a440b167371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.194266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c3aa5-be67-4703-a9a2-6a440b167371 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.194725 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c3aa5-be67-4703-a9a2-6a440b167371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.195172 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c3aa5-be67-4703-a9a2-6a440b167371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.196043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c3aa5-be67-4703-a9a2-6a440b167371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.198190 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c3aa5-be67-4703-a9a2-6a440b167371 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.351709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1264/2555] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:04 2022] POST /identity/v3/projects => generated 397 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:04.355709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd4616-687a-4fb5-91d5-baf147c6fccb admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.365900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd4616-687a-4fb5-91d5-baf147c6fccb admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.431603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02891e7-7020-4df3-92da-de48852f7abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.432251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02891e7-7020-4df3-92da-de48852f7abf admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.437124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02891e7-7020-4df3-92da-de48852f7abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.437124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02891e7-7020-4df3-92da-de48852f7abf admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.437124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02891e7-7020-4df3-92da-de48852f7abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.437124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02891e7-7020-4df3-92da-de48852f7abf admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.516606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1292/2556] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:04 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:04.521448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c3aa5-be67-4703-a9a2-6a440b167371 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.532017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c3aa5-be67-4703-a9a2-6a440b167371 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.537392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaaf9d-65e1-4fd2-9b72-ecbb98af7607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.538054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaaf9d-65e1-4fd2-9b72-ecbb98af7607 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.538340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaaf9d-65e1-4fd2-9b72-ecbb98af7607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.538619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaaf9d-65e1-4fd2-9b72-ecbb98af7607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.539352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaaf9d-65e1-4fd2-9b72-ecbb98af7607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.541051 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaaf9d-65e1-4fd2-9b72-ecbb98af7607 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.551797 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1265/2557] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:04.556118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02891e7-7020-4df3-92da-de48852f7abf admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.566983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02891e7-7020-4df3-92da-de48852f7abf admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.572063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07b757-c585-41af-83f5-d8b4c0746f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.572764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07b757-c585-41af-83f5-d8b4c0746f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.573052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07b757-c585-41af-83f5-d8b4c0746f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.573353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07b757-c585-41af-83f5-d8b4c0746f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.574078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07b757-c585-41af-83f5-d8b4c0746f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.575702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07b757-c585-41af-83f5-d8b4c0746f9a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.587404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1293/2558] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:04.591596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaaf9d-65e1-4fd2-9b72-ecbb98af7607 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.602865 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaaf9d-65e1-4fd2-9b72-ecbb98af7607 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.607544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226a5b3-2d7e-4a6c-9950-ed29ec329447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.608534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226a5b3-2d7e-4a6c-9950-ed29ec329447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.608900 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226a5b3-2d7e-4a6c-9950-ed29ec329447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.609248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226a5b3-2d7e-4a6c-9950-ed29ec329447 admin admin] PATH_INFO: `/v3/projects/377155d00815405d9c0b982d3ba2e5ee/users/88e69080835145078182de99279e5ad1/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.624429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226a5b3-2d7e-4a6c-9950-ed29ec329447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377155d00815405d9c0b982d3ba2e5ee, user_id=88e69080835145078182de99279e5ad1, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.626883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226a5b3-2d7e-4a6c-9950-ed29ec329447 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.698780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1266/2559] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:04 2022] PUT /identity/v3/projects/377155d00815405d9c0b982d3ba2e5ee/users/88e69080835145078182de99279e5ad1/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:04.710988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c3ae2-ec9a-424f-8e88-6120f936c06f None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.711282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c3ae2-ec9a-424f-8e88-6120f936c06f None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.711563 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c3ae2-ec9a-424f-8e88-6120f936c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.731644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:04.739966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-028c3ae2-ec9a-424f-8e88-6120f936c06f None None] MFA Rules not processed for user `88e69080835145078182de99279e5ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:04.741246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-028c3ae2-ec9a-424f-8e88-6120f936c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:04.815969 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1294/2560] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:04.820622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226a5b3-2d7e-4a6c-9950-ed29ec329447 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:04.892194 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226a5b3-2d7e-4a6c-9950-ed29ec329447 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:04.898330 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1976-af02-4404-ba4f-5c31e7d50967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:04.899014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1976-af02-4404-ba4f-5c31e7d50967 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:04.899299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1976-af02-4404-ba4f-5c31e7d50967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:04.899580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1976-af02-4404-ba4f-5c31e7d50967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:04.900540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f1976-af02-4404-ba4f-5c31e7d50967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:04.902494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f1976-af02-4404-ba4f-5c31e7d50967 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:04.992189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1267/2561] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:04 2022] POST /identity/v3/projects => generated 399 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:04.996405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c3ae2-ec9a-424f-8e88-6120f936c06f None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.007491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c3ae2-ec9a-424f-8e88-6120f936c06f None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.068164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a14d-baa9-4578-9e59-8a53b4a1f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.068788 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a14d-baa9-4578-9e59-8a53b4a1f14a admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.069079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a14d-baa9-4578-9e59-8a53b4a1f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.069362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a14d-baa9-4578-9e59-8a53b4a1f14a admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.070137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1a14d-baa9-4578-9e59-8a53b4a1f14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.072083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1a14d-baa9-4578-9e59-8a53b4a1f14a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.193562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1295/2562] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:04 2022] POST /identity/v3/users => generated 306 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:05.194875 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1976-af02-4404-ba4f-5c31e7d50967 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.205208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1976-af02-4404-ba4f-5c31e7d50967 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.210391 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6687bd-c30f-4b6c-a566-be4eb336a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.211065 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6687bd-c30f-4b6c-a566-be4eb336a683 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.211387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6687bd-c30f-4b6c-a566-be4eb336a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.211636 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6687bd-c30f-4b6c-a566-be4eb336a683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.212409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6687bd-c30f-4b6c-a566-be4eb336a683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.214035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6687bd-c30f-4b6c-a566-be4eb336a683 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.226457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1268/2563] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:05.230470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a14d-baa9-4578-9e59-8a53b4a1f14a admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.249920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a14d-baa9-4578-9e59-8a53b4a1f14a admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.255959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a7b0-432e-416a-8fee-9143ed9b61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.257041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a7b0-432e-416a-8fee-9143ed9b61e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.257428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a7b0-432e-416a-8fee-9143ed9b61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.257807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a7b0-432e-416a-8fee-9143ed9b61e0 admin admin] PATH_INFO: `/v3/projects/0934dc7189034ab0b30602235600b2e3/users/6308779853f34e508cdb315d67339144/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.274454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a7b0-432e-416a-8fee-9143ed9b61e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0934dc7189034ab0b30602235600b2e3, user_id=6308779853f34e508cdb315d67339144, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.277397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a7b0-432e-416a-8fee-9143ed9b61e0 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.340653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1296/2564] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:05 2022] PUT /identity/v3/projects/0934dc7189034ab0b30602235600b2e3/users/6308779853f34e508cdb315d67339144/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:05.344649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6687bd-c30f-4b6c-a566-be4eb336a683 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.356129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6687bd-c30f-4b6c-a566-be4eb336a683 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.360332 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:05.417526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47ba6f-a4a5-4d2d-9201-ec49dd7fae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.418119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47ba6f-a4a5-4d2d-9201-ec49dd7fae73 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.418402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47ba6f-a4a5-4d2d-9201-ec49dd7fae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.419328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47ba6f-a4a5-4d2d-9201-ec49dd7fae73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.420069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47ba6f-a4a5-4d2d-9201-ec49dd7fae73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.421741 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47ba6f-a4a5-4d2d-9201-ec49dd7fae73 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.435984 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1269/2565] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:05.438931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a7b0-432e-416a-8fee-9143ed9b61e0 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.450840 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a7b0-432e-416a-8fee-9143ed9b61e0 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.455611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a6eb-3da0-4f79-8fa8-08c8cd7b8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.457052 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a6eb-3da0-4f79-8fa8-08c8cd7b8649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.457343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a6eb-3da0-4f79-8fa8-08c8cd7b8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.457619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a6eb-3da0-4f79-8fa8-08c8cd7b8649 admin admin] PATH_INFO: `/v3/projects/0934dc7189034ab0b30602235600b2e3/users/6308779853f34e508cdb315d67339144/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.459912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38a6eb-3da0-4f79-8fa8-08c8cd7b8649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0934dc7189034ab0b30602235600b2e3, user_id=6308779853f34e508cdb315d67339144, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.462621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38a6eb-3da0-4f79-8fa8-08c8cd7b8649 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.475554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1297/2566] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:05 2022] PUT /identity/v3/projects/0934dc7189034ab0b30602235600b2e3/users/6308779853f34e508cdb315d67339144/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:05.486892 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f66af-d8f6-4347-a62a-ca6f5c45fbd2 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.487181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f66af-d8f6-4347-a62a-ca6f5c45fbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.487491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f66af-d8f6-4347-a62a-ca6f5c45fbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.514642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6c9f66af-d8f6-4347-a62a-ca6f5c45fbd2 None None] MFA Rules not processed for user `6308779853f34e508cdb315d67339144`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:05.515860 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6c9f66af-d8f6-4347-a62a-ca6f5c45fbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:05.589572 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1270/2567] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:05.602168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a6eb-3da0-4f79-8fa8-08c8cd7b8649 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.603981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-cf38a6eb-3da0-4f79-8fa8-08c8cd7b8649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:05.676513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a6eb-3da0-4f79-8fa8-08c8cd7b8649 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.681075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74bdc4-596c-4c16-80f4-fc7e1e2e236b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.682109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74bdc4-596c-4c16-80f4-fc7e1e2e236b service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.682588 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74bdc4-596c-4c16-80f4-fc7e1e2e236b service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.683103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74bdc4-596c-4c16-80f4-fc7e1e2e236b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.694266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:05.697056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74bdc4-596c-4c16-80f4-fc7e1e2e236b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.698672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74bdc4-596c-4c16-80f4-fc7e1e2e236b service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.712255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1298/2568] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:05.909525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f66af-d8f6-4347-a62a-ca6f5c45fbd2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:05.919275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f66af-d8f6-4347-a62a-ca6f5c45fbd2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:05.923257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9be96c-a9b2-4547-be7c-567b4b127adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:05.923987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be96c-a9b2-4547-be7c-567b4b127adc service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:05.924378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be96c-a9b2-4547-be7c-567b4b127adc service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:05.924707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be96c-a9b2-4547-be7c-567b4b127adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:05.985405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9be96c-a9b2-4547-be7c-567b4b127adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:05.986779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9be96c-a9b2-4547-be7c-567b4b127adc service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:05.996873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1271/2569] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:07.516290 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74bdc4-596c-4c16-80f4-fc7e1e2e236b service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:07.517844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ab74bdc4-596c-4c16-80f4-fc7e1e2e236b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:07.585652 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74bdc4-596c-4c16-80f4-fc7e1e2e236b service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:07.590233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:07.591140 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:07.591469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:07.591702 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] PATH_INFO: `/v3/users/718a82d2f4294f68965ce01aac0fc166` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:07.606137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=718a82d2f4294f68965ce01aac0fc166)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:07.608166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:07.782985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718a82d2f4294f68965ce01aac0fc166'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:07.852724 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718a82d2f4294f68965ce01aac0fc166'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:07.853447 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718a82d2f4294f68965ce01aac0fc166'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:07.854146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718a82d2f4294f68965ce01aac0fc166'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:07.863096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d2c1622a-71d1-475b-a71e-f0783da8b6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718a82d2f4294f68965ce01aac0fc166'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:07.885409 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1299/2570] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:07 2022] DELETE /identity/v3/users/718a82d2f4294f68965ce01aac0fc166 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:08.177709 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9be96c-a9b2-4547-be7c-567b4b127adc service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.199380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9be96c-a9b2-4547-be7c-567b4b127adc service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.226859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:08.269175 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.270562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.270851 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.271125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] PATH_INFO: `/v3/projects/e293f2b3de9143ad9e8a1fe8b67d6641` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.290329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e293f2b3de9143ad9e8a1fe8b67d6641)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.292351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.417553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'request_id': 'req-31195dc4-48b6-455e-ba46-48eb4ee8b878'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:08.475394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'request_id': 'req-31195dc4-48b6-455e-ba46-48eb4ee8b878'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:08.482634 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'request_id': 'req-31195dc4-48b6-455e-ba46-48eb4ee8b878'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:08.493336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] The token cache is being invalidate because project e293f2b3de9143ad9e8a1fe8b67d6641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:08.493619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:08.494235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-31195dc4-48b6-455e-ba46-48eb4ee8b878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:08.495769 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1272/2571] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:08 2022] DELETE /identity/v3/projects/e293f2b3de9143ad9e8a1fe8b67d6641 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:08.500677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54834-885e-47e1-87de-e94d1140bfee None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.500972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54834-885e-47e1-87de-e94d1140bfee None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.501252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54834-885e-47e1-87de-e94d1140bfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.521043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-c3c54834-885e-47e1-87de-e94d1140bfee None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:08.522243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c3c54834-885e-47e1-87de-e94d1140bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:08.581583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1300/2572] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:08.589140 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e4d5a-7fb8-468c-911b-d6de8c7e9084 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.589995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e4d5a-7fb8-468c-911b-d6de8c7e9084 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.589995 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e4d5a-7fb8-468c-911b-d6de8c7e9084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.608384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-314e4d5a-7fb8-468c-911b-d6de8c7e9084 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:08.609592 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-314e4d5a-7fb8-468c-911b-d6de8c7e9084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:08.618378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1273/2573] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:08.622818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c54834-885e-47e1-87de-e94d1140bfee None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.629776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:08.633542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c54834-885e-47e1-87de-e94d1140bfee None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.638233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c531b-4e98-4f37-96ba-38d3dbadc96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.638887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c531b-4e98-4f37-96ba-38d3dbadc96a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.639176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c531b-4e98-4f37-96ba-38d3dbadc96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.639458 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c531b-4e98-4f37-96ba-38d3dbadc96a admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.640271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c531b-4e98-4f37-96ba-38d3dbadc96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:08.640627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c531b-4e98-4f37-96ba-38d3dbadc96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.642237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c531b-4e98-4f37-96ba-38d3dbadc96a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.654448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1301/2574] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:08.660769 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e4d5a-7fb8-468c-911b-d6de8c7e9084 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.668818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e4d5a-7fb8-468c-911b-d6de8c7e9084 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.673529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca80c0a-3454-421f-ab55-e0358c451e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.674179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca80c0a-3454-421f-ab55-e0358c451e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.674461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca80c0a-3454-421f-ab55-e0358c451e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.675332 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca80c0a-3454-421f-ab55-e0358c451e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.676054 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca80c0a-3454-421f-ab55-e0358c451e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.677988 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca80c0a-3454-421f-ab55-e0358c451e39 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.762758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1274/2575] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:08 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:08.766852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c531b-4e98-4f37-96ba-38d3dbadc96a admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.777972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c531b-4e98-4f37-96ba-38d3dbadc96a admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.834520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202b7ea-fcef-417c-9f2f-05432fa5c00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.835103 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202b7ea-fcef-417c-9f2f-05432fa5c00e admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.835386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202b7ea-fcef-417c-9f2f-05432fa5c00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.835662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202b7ea-fcef-417c-9f2f-05432fa5c00e admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.836409 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202b7ea-fcef-417c-9f2f-05432fa5c00e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.838315 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202b7ea-fcef-417c-9f2f-05432fa5c00e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.944160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1302/2576] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:08 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:08.949508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca80c0a-3454-421f-ab55-e0358c451e39 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.960246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca80c0a-3454-421f-ab55-e0358c451e39 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:08.964857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a44d4-a2bb-4ac6-91a9-39dbaa9ca393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:08.965550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a44d4-a2bb-4ac6-91a9-39dbaa9ca393 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:08.965836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a44d4-a2bb-4ac6-91a9-39dbaa9ca393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:08.966114 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a44d4-a2bb-4ac6-91a9-39dbaa9ca393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:08.966837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a44d4-a2bb-4ac6-91a9-39dbaa9ca393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:08.968616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a44d4-a2bb-4ac6-91a9-39dbaa9ca393 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:08.980006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1275/2577] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:08.983991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202b7ea-fcef-417c-9f2f-05432fa5c00e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:08.995920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202b7ea-fcef-417c-9f2f-05432fa5c00e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:09.000581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2fcf8-3f22-4a46-b091-22d8057b410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:09.001233 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2fcf8-3f22-4a46-b091-22d8057b410a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.001517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2fcf8-3f22-4a46-b091-22d8057b410a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.001791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2fcf8-3f22-4a46-b091-22d8057b410a admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.002508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2fcf8-3f22-4a46-b091-22d8057b410a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:09.004109 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2fcf8-3f22-4a46-b091-22d8057b410a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:09.013957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1303/2578] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:09.017979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a44d4-a2bb-4ac6-91a9-39dbaa9ca393 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:09.028997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a44d4-a2bb-4ac6-91a9-39dbaa9ca393 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:09.033764 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797addc-facf-430d-952a-ee98e21da675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:09.035221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797addc-facf-430d-952a-ee98e21da675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.035501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797addc-facf-430d-952a-ee98e21da675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.035777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797addc-facf-430d-952a-ee98e21da675 admin admin] PATH_INFO: `/v3/projects/59f0586e369e4e4bafbfb38448dd7300/users/1de145b7348a422f88268a45966865b4/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.050168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797addc-facf-430d-952a-ee98e21da675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f0586e369e4e4bafbfb38448dd7300, user_id=1de145b7348a422f88268a45966865b4, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:09.052903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797addc-facf-430d-952a-ee98e21da675 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:09.120874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1276/2579] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:09 2022] PUT /identity/v3/projects/59f0586e369e4e4bafbfb38448dd7300/users/1de145b7348a422f88268a45966865b4/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:09.137726 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ecd6-8fe3-432b-a578-7f7827aa3d8e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.138017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ecd6-8fe3-432b-a578-7f7827aa3d8e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.138297 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ecd6-8fe3-432b-a578-7f7827aa3d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.165811 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-44f1ecd6-8fe3-432b-a578-7f7827aa3d8e None None] MFA Rules not processed for user `1de145b7348a422f88268a45966865b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:09.167026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-44f1ecd6-8fe3-432b-a578-7f7827aa3d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:09.238306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1304/2580] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:09.242898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797addc-facf-430d-952a-ee98e21da675 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:09.291558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:09.308229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797addc-facf-430d-952a-ee98e21da675 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:09.313046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438c5ce-d294-4703-a552-a217368835f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:09.313713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438c5ce-d294-4703-a552-a217368835f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.314056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438c5ce-d294-4703-a552-a217368835f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.314349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438c5ce-d294-4703-a552-a217368835f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.315339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438c5ce-d294-4703-a552-a217368835f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:09.317686 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438c5ce-d294-4703-a552-a217368835f9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:09.404256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1277/2581] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:09 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:09.408347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1ecd6-8fe3-432b-a578-7f7827aa3d8e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:09.419745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1ecd6-8fe3-432b-a578-7f7827aa3d8e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:09.487396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3223386-cb73-44e6-80e4-cebf0e27f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:09.488428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3223386-cb73-44e6-80e4-cebf0e27f061 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.488843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3223386-cb73-44e6-80e4-cebf0e27f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.489248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3223386-cb73-44e6-80e4-cebf0e27f061 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.490056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3223386-cb73-44e6-80e4-cebf0e27f061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:09.492512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3223386-cb73-44e6-80e4-cebf0e27f061 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:09.500634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:09.593492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1305/2582] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:09 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:09.594945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438c5ce-d294-4703-a552-a217368835f9 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:09.607076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438c5ce-d294-4703-a552-a217368835f9 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:09.619048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d0a74-af8d-400a-92f6-6fa8a09d0433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:09.619718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d0a74-af8d-400a-92f6-6fa8a09d0433 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.620002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d0a74-af8d-400a-92f6-6fa8a09d0433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.620328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d0a74-af8d-400a-92f6-6fa8a09d0433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.621050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d0a74-af8d-400a-92f6-6fa8a09d0433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:09.622678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d0a74-af8d-400a-92f6-6fa8a09d0433 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:09.634767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1278/2583] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:09.638895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3223386-cb73-44e6-80e4-cebf0e27f061 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:09.649773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3223386-cb73-44e6-80e4-cebf0e27f061 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:09.654411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072648-8981-4690-9cff-80292e08692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:09.655430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072648-8981-4690-9cff-80292e08692e admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.655612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072648-8981-4690-9cff-80292e08692e admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.655894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072648-8981-4690-9cff-80292e08692e admin admin] PATH_INFO: `/v3/projects/ae2e1cf0acce4718b32dc064418e3fdc/users/ed88f0cacff74b80986919bf64b01f13/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.675753 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6072648-8981-4690-9cff-80292e08692e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2e1cf0acce4718b32dc064418e3fdc, user_id=ed88f0cacff74b80986919bf64b01f13, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:09.678469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6072648-8981-4690-9cff-80292e08692e admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:09.767071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1306/2584] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:09 2022] PUT /identity/v3/projects/ae2e1cf0acce4718b32dc064418e3fdc/users/ed88f0cacff74b80986919bf64b01f13/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:09.771203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d0a74-af8d-400a-92f6-6fa8a09d0433 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:09.781110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d0a74-af8d-400a-92f6-6fa8a09d0433 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:09.839073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192816d0-06ff-44c2-a076-6a2cc704a2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:09.839768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192816d0-06ff-44c2-a076-6a2cc704a2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.840331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192816d0-06ff-44c2-a076-6a2cc704a2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.840762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192816d0-06ff-44c2-a076-6a2cc704a2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.841482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192816d0-06ff-44c2-a076-6a2cc704a2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:09.843225 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192816d0-06ff-44c2-a076-6a2cc704a2ea admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:09.856627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1279/2585] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:09.857902 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072648-8981-4690-9cff-80292e08692e admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:09.868821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072648-8981-4690-9cff-80292e08692e admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:09.873517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e894ffb-1dc5-43cf-b717-7ae75b5ff512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:09.874395 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e894ffb-1dc5-43cf-b717-7ae75b5ff512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.874675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e894ffb-1dc5-43cf-b717-7ae75b5ff512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.874947 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e894ffb-1dc5-43cf-b717-7ae75b5ff512 admin admin] PATH_INFO: `/v3/projects/ae2e1cf0acce4718b32dc064418e3fdc/users/ed88f0cacff74b80986919bf64b01f13/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.876944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e894ffb-1dc5-43cf-b717-7ae75b5ff512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2e1cf0acce4718b32dc064418e3fdc, user_id=ed88f0cacff74b80986919bf64b01f13, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:09.880370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e894ffb-1dc5-43cf-b717-7ae75b5ff512 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:09.890994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1307/2586] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:09 2022] PUT /identity/v3/projects/ae2e1cf0acce4718b32dc064418e3fdc/users/ed88f0cacff74b80986919bf64b01f13/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:09.903779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756451c0-e8c2-4b59-817b-0c356ee3547a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:09.904075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756451c0-e8c2-4b59-817b-0c356ee3547a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:09.904397 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756451c0-e8c2-4b59-817b-0c356ee3547a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:09.932584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-756451c0-e8c2-4b59-817b-0c356ee3547a None None] MFA Rules not processed for user `ed88f0cacff74b80986919bf64b01f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:09.933809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-756451c0-e8c2-4b59-817b-0c356ee3547a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:10.007209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1280/2587] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:10.018221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e894ffb-1dc5-43cf-b717-7ae75b5ff512 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:10.020631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8e894ffb-1dc5-43cf-b717-7ae75b5ff512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:10.092554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e894ffb-1dc5-43cf-b717-7ae75b5ff512 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:10.096325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448140f-32ea-47d3-84ee-29ec40ffcf51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:10.097907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448140f-32ea-47d3-84ee-29ec40ffcf51 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.098197 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448140f-32ea-47d3-84ee-29ec40ffcf51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.098481 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448140f-32ea-47d3-84ee-29ec40ffcf51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.108501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448140f-32ea-47d3-84ee-29ec40ffcf51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:10.110011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448140f-32ea-47d3-84ee-29ec40ffcf51 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:10.120130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1308/2588] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:10.227956 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756451c0-e8c2-4b59-817b-0c356ee3547a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:10.237680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756451c0-e8c2-4b59-817b-0c356ee3547a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:10.241545 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81e927-65ed-4636-82d5-85b67d54c019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:10.242258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81e927-65ed-4636-82d5-85b67d54c019 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:10.242610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81e927-65ed-4636-82d5-85b67d54c019 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:10.242957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81e927-65ed-4636-82d5-85b67d54c019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:10.283941 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:10.302400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81e927-65ed-4636-82d5-85b67d54c019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:10.303899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81e927-65ed-4636-82d5-85b67d54c019 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:10.313735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1281/2589] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:11.099027 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448140f-32ea-47d3-84ee-29ec40ffcf51 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.104045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0448140f-32ea-47d3-84ee-29ec40ffcf51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:11.171199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448140f-32ea-47d3-84ee-29ec40ffcf51 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.176416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.177360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.177644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.177918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] PATH_INFO: `/v3/users/88e69080835145078182de99279e5ad1` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.179120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e69080835145078182de99279e5ad1)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.181137 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.351154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e69080835145078182de99279e5ad1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:11.407000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e69080835145078182de99279e5ad1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:11.407626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e69080835145078182de99279e5ad1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:11.408234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e69080835145078182de99279e5ad1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:11.411892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:11.418282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e69080835145078182de99279e5ad1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:11.438188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1309/2590] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:11 2022] DELETE /identity/v3/users/88e69080835145078182de99279e5ad1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:11.442796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1c62-1ff1-4076-9663-49d7bc83071a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.443305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1c62-1ff1-4076-9663-49d7bc83071a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.443434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1c62-1ff1-4076-9663-49d7bc83071a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.463517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-688a1c62-1ff1-4076-9663-49d7bc83071a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:11.464909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-688a1c62-1ff1-4076-9663-49d7bc83071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:11.539025 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1282/2591] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:11.548549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:11.551289 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:11.615899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2864-8b63-47ae-afc8-f163047c2d0d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:11.619650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc8c19-d72b-4e08-b4f2-507095ea2ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:11.620347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc8c19-d72b-4e08-b4f2-507095ea2ece service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:11.620619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc8c19-d72b-4e08-b4f2-507095ea2ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:11.620941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc8c19-d72b-4e08-b4f2-507095ea2ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:11.630936 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc8c19-d72b-4e08-b4f2-507095ea2ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:11.632417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc8c19-d72b-4e08-b4f2-507095ea2ece service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:11.641994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1310/2592] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:12.038866 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a1c62-1ff1-4076-9663-49d7bc83071a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:12.040367 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-688a1c62-1ff1-4076-9663-49d7bc83071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:12.075012 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a1c62-1ff1-4076-9663-49d7bc83071a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:12.090942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:12.100357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:12.100357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:12.100357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] PATH_INFO: `/v3/projects/377155d00815405d9c0b982d3ba2e5ee` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:12.100357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=377155d00815405d9c0b982d3ba2e5ee)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:12.106714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:12.226353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377155d00815405d9c0b982d3ba2e5ee', 'request_id': 'req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.303143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377155d00815405d9c0b982d3ba2e5ee', 'request_id': 'req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.310131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377155d00815405d9c0b982d3ba2e5ee', 'request_id': 'req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.321005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] The token cache is being invalidate because project 377155d00815405d9c0b982d3ba2e5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:12.321305 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.321942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.323522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1283/2593] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:12 2022] DELETE /identity/v3/projects/377155d00815405d9c0b982d3ba2e5ee => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:12.327493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc8c19-d72b-4e08-b4f2-507095ea2ece service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:12.338968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc8c19-d72b-4e08-b4f2-507095ea2ece service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:12.399163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:12.400069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:12.400383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:12.400668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] PATH_INFO: `/v3/users/6308779853f34e508cdb315d67339144` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:12.401856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6308779853f34e508cdb315d67339144)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:12.403884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:12.630038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6308779853f34e508cdb315d67339144'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.704016 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6308779853f34e508cdb315d67339144'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.704804 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6308779853f34e508cdb315d67339144'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.705416 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6308779853f34e508cdb315d67339144'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.713350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-9fb82026-22da-44ad-840c-f6c61f200ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6308779853f34e508cdb315d67339144'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:12.725230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:12.733488 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1311/2594] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:12 2022] DELETE /identity/v3/users/6308779853f34e508cdb315d67339144 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:13.174119 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.175738 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:13.191094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d154215-4a51-49fa-a071-eb2cc9ea2b7e admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.254087 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.254957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.255249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.255527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] PATH_INFO: `/v3/projects/0934dc7189034ab0b30602235600b2e3` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.256852 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0934dc7189034ab0b30602235600b2e3)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.258799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.261182 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:13.372815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0934dc7189034ab0b30602235600b2e3', 'request_id': 'req-12e95d75-db9d-4781-9d27-460a13c084a0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.441108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0934dc7189034ab0b30602235600b2e3', 'request_id': 'req-12e95d75-db9d-4781-9d27-460a13c084a0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.447557 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0934dc7189034ab0b30602235600b2e3', 'request_id': 'req-12e95d75-db9d-4781-9d27-460a13c084a0'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.458890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] The token cache is being invalidate because project 0934dc7189034ab0b30602235600b2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:13.459180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.459809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.461392 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1284/2595] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:13 2022] DELETE /identity/v3/projects/0934dc7189034ab0b30602235600b2e3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:13.466361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fafe0-cbc8-4227-8a7c-28d2153a1fa3 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.466854 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fafe0-cbc8-4227-8a7c-28d2153a1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.466968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fafe0-cbc8-4227-8a7c-28d2153a1fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.485205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8c9fafe0-cbc8-4227-8a7c-28d2153a1fa3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:13.486706 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8c9fafe0-cbc8-4227-8a7c-28d2153a1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:13.492179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.493567 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:13.547971 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1312/2596] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:13.556267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400796cd-03d2-4fbb-afd5-08a6b197afce None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.556511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e95d75-db9d-4781-9d27-460a13c084a0 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.556646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400796cd-03d2-4fbb-afd5-08a6b197afce None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.556851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400796cd-03d2-4fbb-afd5-08a6b197afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.561118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.561979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.562257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.562530 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] PATH_INFO: `/v3/users/1de145b7348a422f88268a45966865b4` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.563859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de145b7348a422f88268a45966865b4)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.566611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.575240 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-400796cd-03d2-4fbb-afd5-08a6b197afce None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:13.576482 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-400796cd-03d2-4fbb-afd5-08a6b197afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:13.584827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1313/2597] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:13.588838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400796cd-03d2-4fbb-afd5-08a6b197afce None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.597893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400796cd-03d2-4fbb-afd5-08a6b197afce None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.602545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cfaa8-ab6e-44b3-acb0-cb0020c632e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.603183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cfaa8-ab6e-44b3-acb0-cb0020c632e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.603467 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cfaa8-ab6e-44b3-acb0-cb0020c632e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.603742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cfaa8-ab6e-44b3-acb0-cb0020c632e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.604499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cfaa8-ab6e-44b3-acb0-cb0020c632e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:13.604815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cfaa8-ab6e-44b3-acb0-cb0020c632e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.606424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cfaa8-ab6e-44b3-acb0-cb0020c632e8 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.618570 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1314/2598] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:13.622682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cfaa8-ab6e-44b3-acb0-cb0020c632e8 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.632807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cfaa8-ab6e-44b3-acb0-cb0020c632e8 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.637396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba2e40-6cb8-4059-9503-8376b809c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.638006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba2e40-6cb8-4059-9503-8376b809c656 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.638291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba2e40-6cb8-4059-9503-8376b809c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.638566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba2e40-6cb8-4059-9503-8376b809c656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.639239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba2e40-6cb8-4059-9503-8376b809c656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.641129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba2e40-6cb8-4059-9503-8376b809c656 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.734997 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de145b7348a422f88268a45966865b4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.735612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de145b7348a422f88268a45966865b4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.740312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1315/2599] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:13 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:13.743642 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de145b7348a422f88268a45966865b4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.744325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba2e40-6cb8-4059-9503-8376b809c656 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.756436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de145b7348a422f88268a45966865b4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.808217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba2e40-6cb8-4059-9503-8376b809c656 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.813105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53a140-669b-4960-bb74-6828c64e8022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.813803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53a140-669b-4960-bb74-6828c64e8022 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.814090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53a140-669b-4960-bb74-6828c64e8022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.814368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53a140-669b-4960-bb74-6828c64e8022 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.815055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53a140-669b-4960-bb74-6828c64e8022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.817714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53a140-669b-4960-bb74-6828c64e8022 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.823619 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-56019626-ae82-409d-979a-a7f9f7647aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de145b7348a422f88268a45966865b4'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:13.830272 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1285/2600] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:13 2022] DELETE /identity/v3/users/1de145b7348a422f88268a45966865b4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:13.835033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e126c-4e64-4960-a001-8911acb39cdf None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.835319 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e126c-4e64-4960-a001-8911acb39cdf None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.835593 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e126c-4e64-4960-a001-8911acb39cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.853324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-718e126c-4e64-4960-a001-8911acb39cdf None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:13.854520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-718e126c-4e64-4960-a001-8911acb39cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:13.859472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:13.887882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1316/2601] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:13 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:13.891867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53a140-669b-4960-bb74-6828c64e8022 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.893750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9a53a140-669b-4960-bb74-6828c64e8022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:13.908793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53a140-669b-4960-bb74-6828c64e8022 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:13.920516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1286/2602] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:13.934032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e126c-4e64-4960-a001-8911acb39cdf None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:13.935467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-718e126c-4e64-4960-a001-8911acb39cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:13.959832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:13.981992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad219a5-cf9e-40ec-8324-95f9e25f9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:13.982448 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad219a5-cf9e-40ec-8324-95f9e25f9751 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:13.983172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad219a5-cf9e-40ec-8324-95f9e25f9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:13.983459 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad219a5-cf9e-40ec-8324-95f9e25f9751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:13.984573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad219a5-cf9e-40ec-8324-95f9e25f9751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:13.986256 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad219a5-cf9e-40ec-8324-95f9e25f9751 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:13.997658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1317/2603] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:14.003084 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e126c-4e64-4960-a001-8911acb39cdf None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.007376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad219a5-cf9e-40ec-8324-95f9e25f9751 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.008681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad06b2a-43f3-43d9-baf6-a381b5f5fdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.009474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad06b2a-43f3-43d9-baf6-a381b5f5fdab service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.009823 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad06b2a-43f3-43d9-baf6-a381b5f5fdab service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.010168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad06b2a-43f3-43d9-baf6-a381b5f5fdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.021865 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad219a5-cf9e-40ec-8324-95f9e25f9751 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.024136 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad06b2a-43f3-43d9-baf6-a381b5f5fdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.025815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad06b2a-43f3-43d9-baf6-a381b5f5fdab service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.027886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31802280-f64a-4180-abd4-38d0ee03a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.028604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31802280-f64a-4180-abd4-38d0ee03a4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.028887 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31802280-f64a-4180-abd4-38d0ee03a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.029164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31802280-f64a-4180-abd4-38d0ee03a4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.030020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31802280-f64a-4180-abd4-38d0ee03a4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.031784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31802280-f64a-4180-abd4-38d0ee03a4e3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.039002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1287/2604] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:14.052547 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1318/2605] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:14.057663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad06b2a-43f3-43d9-baf6-a381b5f5fdab service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.067241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad06b2a-43f3-43d9-baf6-a381b5f5fdab service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.071901 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbafb5-3da5-433f-b382-cd666bc59c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.072821 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbafb5-3da5-433f-b382-cd666bc59c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.073099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbafb5-3da5-433f-b382-cd666bc59c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.073368 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbafb5-3da5-433f-b382-cd666bc59c0b admin admin] PATH_INFO: `/v3/projects/a83670b2134e45368bd6dc926d6c1a9a/users/2c85415b4af449e1adbfeea5ca093077/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.088415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbafb5-3da5-433f-b382-cd666bc59c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83670b2134e45368bd6dc926d6c1a9a, user_id=2c85415b4af449e1adbfeea5ca093077, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.094127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbafb5-3da5-433f-b382-cd666bc59c0b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.167507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1288/2606] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:14 2022] PUT /identity/v3/projects/a83670b2134e45368bd6dc926d6c1a9a/users/2c85415b4af449e1adbfeea5ca093077/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:14.178790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c109-8978-4f99-a50e-ab23a5b19ea7 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.179088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c109-8978-4f99-a50e-ab23a5b19ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.179375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c109-8978-4f99-a50e-ab23a5b19ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.206471 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-3af1c109-8978-4f99-a50e-ab23a5b19ea7 None None] MFA Rules not processed for user `2c85415b4af449e1adbfeea5ca093077`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:14.207931 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3af1c109-8978-4f99-a50e-ab23a5b19ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:14.281406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1319/2607] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:14.296035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbafb5-3da5-433f-b382-cd666bc59c0b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.299218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-49bbafb5-3da5-433f-b382-cd666bc59c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:14.366203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbafb5-3da5-433f-b382-cd666bc59c0b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.369926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871dbf9-4716-4cc6-bcd4-f48bbc4e3ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.370576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871dbf9-4716-4cc6-bcd4-f48bbc4e3ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.370962 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871dbf9-4716-4cc6-bcd4-f48bbc4e3ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.371246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871dbf9-4716-4cc6-bcd4-f48bbc4e3ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.380442 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871dbf9-4716-4cc6-bcd4-f48bbc4e3ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.382127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871dbf9-4716-4cc6-bcd4-f48bbc4e3ab7 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.391926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1289/2608] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:14.418394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1c109-8978-4f99-a50e-ab23a5b19ea7 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.480419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1c109-8978-4f99-a50e-ab23a5b19ea7 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.485767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.486665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.487005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.487378 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] PATH_INFO: `/v3/users/2c85415b4af449e1adbfeea5ca093077` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.488664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c85415b4af449e1adbfeea5ca093077)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.490629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.534951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871dbf9-4716-4cc6-bcd4-f48bbc4e3ab7 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.536493 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d871dbf9-4716-4cc6-bcd4-f48bbc4e3ab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:14.553629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871dbf9-4716-4cc6-bcd4-f48bbc4e3ab7 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.560036 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.560973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.561312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.561587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] PATH_INFO: `/v3/projects/59f0586e369e4e4bafbfb38448dd7300` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.562968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f0586e369e4e4bafbfb38448dd7300)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.565289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.682465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:14.706600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c85415b4af449e1adbfeea5ca093077'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.714100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f0586e369e4e4bafbfb38448dd7300', 'request_id': 'req-12ad97cb-3519-4fea-a31a-22373ea166fe'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.783560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c85415b4af449e1adbfeea5ca093077'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.784411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c85415b4af449e1adbfeea5ca093077'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.784956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c85415b4af449e1adbfeea5ca093077'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.790647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:14.792651 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-2258d77e-f730-458f-b726-f0c58ddc61d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c85415b4af449e1adbfeea5ca093077'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.811370 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1320/2609] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:14 2022] DELETE /identity/v3/users/2c85415b4af449e1adbfeea5ca093077 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:14.816491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77be9c-72a3-4d2d-bfce-ce136f1b94c6 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.816789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77be9c-72a3-4d2d-bfce-ce136f1b94c6 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.817075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77be9c-72a3-4d2d-bfce-ce136f1b94c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.834996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f0586e369e4e4bafbfb38448dd7300', 'request_id': 'req-12ad97cb-3519-4fea-a31a-22373ea166fe'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.835176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-2d77be9c-72a3-4d2d-bfce-ce136f1b94c6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:14.836371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2d77be9c-72a3-4d2d-bfce-ce136f1b94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:14.841969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f0586e369e4e4bafbfb38448dd7300', 'request_id': 'req-12ad97cb-3519-4fea-a31a-22373ea166fe'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.852776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] The token cache is being invalidate because project 59f0586e369e4e4bafbfb38448dd7300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:14.853097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.853760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:14.855405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1290/2610] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:14 2022] DELETE /identity/v3/projects/59f0586e369e4e4bafbfb38448dd7300 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:14.859486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.860881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:14.896919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1321/2611] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:14.906572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77be9c-72a3-4d2d-bfce-ce136f1b94c6 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:14.907969 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-2d77be9c-72a3-4d2d-bfce-ce136f1b94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:14.925336 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad97cb-3519-4fea-a31a-22373ea166fe admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.930883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.932386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.932930 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.934260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] PATH_INFO: `/v3/users/ed88f0cacff74b80986919bf64b01f13` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.935717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed88f0cacff74b80986919bf64b01f13)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.937765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.969060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77be9c-72a3-4d2d-bfce-ce136f1b94c6 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:14.972937 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6482d-7d2f-44f6-a122-32869a20edec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:14.973578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6482d-7d2f-44f6-a122-32869a20edec service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:14.973862 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6482d-7d2f-44f6-a122-32869a20edec service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:14.974165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6482d-7d2f-44f6-a122-32869a20edec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:14.983813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6482d-7d2f-44f6-a122-32869a20edec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:14.985738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6482d-7d2f-44f6-a122-32869a20edec service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:14.995776 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1322/2612] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:15.141205 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed88f0cacff74b80986919bf64b01f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.141861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed88f0cacff74b80986919bf64b01f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.148904 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed88f0cacff74b80986919bf64b01f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.162338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed88f0cacff74b80986919bf64b01f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.395462 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed88f0cacff74b80986919bf64b01f13'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.404945 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1291/2613] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:14 2022] DELETE /identity/v3/users/ed88f0cacff74b80986919bf64b01f13 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:15.427869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6482d-7d2f-44f6-a122-32869a20edec service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:15.429425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-23c6482d-7d2f-44f6-a122-32869a20edec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:15.437055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:15.438475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:15.444077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6482d-7d2f-44f6-a122-32869a20edec service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:15.484633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:15.502708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11eb1f-abc7-466d-b30c-d83c0ad1ab0b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:15.506591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f003b3-22a8-4b02-9459-89ffef0d4a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:15.507361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f003b3-22a8-4b02-9459-89ffef0d4a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.507644 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f003b3-22a8-4b02-9459-89ffef0d4a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.507919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f003b3-22a8-4b02-9459-89ffef0d4a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.510379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a0f003b3-22a8-4b02-9459-89ffef0d4a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:15.514404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:15.515282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.515567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.515846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] PATH_INFO: `/v3/projects/a83670b2134e45368bd6dc926d6c1a9a` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.517041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83670b2134e45368bd6dc926d6c1a9a)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:15.519225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:15.524513 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f003b3-22a8-4b02-9459-89ffef0d4a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:15.526732 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f003b3-22a8-4b02-9459-89ffef0d4a3c service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:15.538424 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1292/2614] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:15.545704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:15.625261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83670b2134e45368bd6dc926d6c1a9a', 'request_id': 'req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.631480 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83670b2134e45368bd6dc926d6c1a9a', 'request_id': 'req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.698886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83670b2134e45368bd6dc926d6c1a9a', 'request_id': 'req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.712258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] The token cache is being invalidate because project a83670b2134e45368bd6dc926d6c1a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:15.712855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.713852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-a1b2d33d-6cbd-4b9e-a3b9-f010dbff7410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:15.715777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1323/2615] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:15 2022] DELETE /identity/v3/projects/a83670b2134e45368bd6dc926d6c1a9a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:15.720633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f08c2-29f8-4b44-b6eb-b62e4410d953 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.720928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f08c2-29f8-4b44-b6eb-b62e4410d953 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.722173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f08c2-29f8-4b44-b6eb-b62e4410d953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.743223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d33f08c2-29f8-4b44-b6eb-b62e4410d953 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:15.744830 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d33f08c2-29f8-4b44-b6eb-b62e4410d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:15.809622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1293/2616] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:15.818654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa000b69-4046-47e0-a8e6-71535e41a39b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.819004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa000b69-4046-47e0-a8e6-71535e41a39b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.819216 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa000b69-4046-47e0-a8e6-71535e41a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.839858 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-fa000b69-4046-47e0-a8e6-71535e41a39b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:15.841124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-fa000b69-4046-47e0-a8e6-71535e41a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:15.850241 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1324/2617] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:15.854198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f08c2-29f8-4b44-b6eb-b62e4410d953 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:15.854318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa000b69-4046-47e0-a8e6-71535e41a39b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:15.855625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d33f08c2-29f8-4b44-b6eb-b62e4410d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:15.868341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f08c2-29f8-4b44-b6eb-b62e4410d953 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:15.869978 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa000b69-4046-47e0-a8e6-71535e41a39b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:15.874447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:15.875419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.875591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.875870 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] PATH_INFO: `/v3/projects/ae2e1cf0acce4718b32dc064418e3fdc` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.878257 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2e1cf0acce4718b32dc064418e3fdc)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:15.879797 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:15.883545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca4046-3068-41cb-bd5e-8585cc60a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:15.884498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca4046-3068-41cb-bd5e-8585cc60a012 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.889068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca4046-3068-41cb-bd5e-8585cc60a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.889068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca4046-3068-41cb-bd5e-8585cc60a012 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.889068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca4046-3068-41cb-bd5e-8585cc60a012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:15.889068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca4046-3068-41cb-bd5e-8585cc60a012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:15.889068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca4046-3068-41cb-bd5e-8585cc60a012 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:15.906852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1325/2618] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:15.907873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca4046-3068-41cb-bd5e-8585cc60a012 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:15.920352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca4046-3068-41cb-bd5e-8585cc60a012 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:15.925062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b12b28-ef30-4d55-9365-fbe3a82fe3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:15.925821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b12b28-ef30-4d55-9365-fbe3a82fe3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:15.928961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b12b28-ef30-4d55-9365-fbe3a82fe3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:15.928961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b12b28-ef30-4d55-9365-fbe3a82fe3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:15.928961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b12b28-ef30-4d55-9365-fbe3a82fe3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:15.929574 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b12b28-ef30-4d55-9365-fbe3a82fe3f2 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.019998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2e1cf0acce4718b32dc064418e3fdc', 'request_id': 'req-3b3ed04e-3d11-4753-aba1-60493ac84ef9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:16.059286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1326/2619] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:15 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:16.063125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b12b28-ef30-4d55-9365-fbe3a82fe3f2 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.103203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2e1cf0acce4718b32dc064418e3fdc', 'request_id': 'req-3b3ed04e-3d11-4753-aba1-60493ac84ef9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:16.111309 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2e1cf0acce4718b32dc064418e3fdc', 'request_id': 'req-3b3ed04e-3d11-4753-aba1-60493ac84ef9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:16.122341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] The token cache is being invalidate because project ae2e1cf0acce4718b32dc064418e3fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:16.122626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:16.123308 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-3b3ed04e-3d11-4753-aba1-60493ac84ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:16.125165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1294/2620] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:15 2022] DELETE /identity/v3/projects/ae2e1cf0acce4718b32dc064418e3fdc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:16.130338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fa484-23a6-45fd-ae3a-98ddb163f5a3 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.130519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fa484-23a6-45fd-ae3a-98ddb163f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.131181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fa484-23a6-45fd-ae3a-98ddb163f5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.137053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b12b28-ef30-4d55-9365-fbe3a82fe3f2 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.142935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c054f-4e01-400e-8ee6-4f1e5ac63eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.148511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c054f-4e01-400e-8ee6-4f1e5ac63eae admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.148948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c054f-4e01-400e-8ee6-4f1e5ac63eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.149230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c054f-4e01-400e-8ee6-4f1e5ac63eae admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.149972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c054f-4e01-400e-8ee6-4f1e5ac63eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.150969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-eb9fa484-23a6-45fd-ae3a-98ddb163f5a3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:16.152385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c054f-4e01-400e-8ee6-4f1e5ac63eae admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.152522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-eb9fa484-23a6-45fd-ae3a-98ddb163f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:16.161218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1295/2621] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:16.174356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d44dc-d434-41df-9d6d-4b57d9bd9603 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.174356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d44dc-d434-41df-9d6d-4b57d9bd9603 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.174356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d44dc-d434-41df-9d6d-4b57d9bd9603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.186897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-5e9d44dc-d434-41df-9d6d-4b57d9bd9603 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:16.188097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5e9d44dc-d434-41df-9d6d-4b57d9bd9603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:16.196695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1296/2622] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:16.200771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d44dc-d434-41df-9d6d-4b57d9bd9603 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.210702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d44dc-d434-41df-9d6d-4b57d9bd9603 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.221611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e280c4-3c81-4d52-9a66-0e367b9413f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.222289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e280c4-3c81-4d52-9a66-0e367b9413f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.222574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e280c4-3c81-4d52-9a66-0e367b9413f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.222857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e280c4-3c81-4d52-9a66-0e367b9413f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.223591 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e280c4-3c81-4d52-9a66-0e367b9413f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:16.223937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e280c4-3c81-4d52-9a66-0e367b9413f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.225590 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e280c4-3c81-4d52-9a66-0e367b9413f4 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.237260 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1327/2623] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:16.243281 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c054f-4e01-400e-8ee6-4f1e5ac63eae admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.243421 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1297/2624] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:16.243528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-459c054f-4e01-400e-8ee6-4f1e5ac63eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:16.246018 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e280c4-3c81-4d52-9a66-0e367b9413f4 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.258046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c054f-4e01-400e-8ee6-4f1e5ac63eae admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.258176 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e280c4-3c81-4d52-9a66-0e367b9413f4 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.263262 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac2945-97f1-4d70-a1a0-edd6b71fa6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.264167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2945-97f1-4d70-a1a0-edd6b71fa6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.264288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdddf5b-0569-47f0-ac54-51001cf9ada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.264667 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2945-97f1-4d70-a1a0-edd6b71fa6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.264957 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdddf5b-0569-47f0-ac54-51001cf9ada2 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.265134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2945-97f1-4d70-a1a0-edd6b71fa6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.265774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdddf5b-0569-47f0-ac54-51001cf9ada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.266046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac2945-97f1-4d70-a1a0-edd6b71fa6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.266158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdddf5b-0569-47f0-ac54-51001cf9ada2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.266746 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdddf5b-0569-47f0-ac54-51001cf9ada2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.267903 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac2945-97f1-4d70-a1a0-edd6b71fa6b4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.269853 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdddf5b-0569-47f0-ac54-51001cf9ada2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.280121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1328/2625] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:16.283708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac2945-97f1-4d70-a1a0-edd6b71fa6b4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.294265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac2945-97f1-4d70-a1a0-edd6b71fa6b4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.298923 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e28734-99be-480f-9923-baa4230be38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.300194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28734-99be-480f-9923-baa4230be38a admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.300539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28734-99be-480f-9923-baa4230be38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.300802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28734-99be-480f-9923-baa4230be38a admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.301650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e28734-99be-480f-9923-baa4230be38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.303255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e28734-99be-480f-9923-baa4230be38a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.314089 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1329/2626] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:16.318327 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e28734-99be-480f-9923-baa4230be38a admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.327976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e28734-99be-480f-9923-baa4230be38a admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.333243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f606ef0-a187-47a6-aff6-6bc31f562adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.334139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f606ef0-a187-47a6-aff6-6bc31f562adb admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.334424 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f606ef0-a187-47a6-aff6-6bc31f562adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.334827 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f606ef0-a187-47a6-aff6-6bc31f562adb admin admin] PATH_INFO: `/v3/projects/02cdf96cb4fd42519f35d0fe325ce2c8/users/6b8d2ada97d04fbd9224df7386d3ada8/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.351202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f606ef0-a187-47a6-aff6-6bc31f562adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=02cdf96cb4fd42519f35d0fe325ce2c8, user_id=6b8d2ada97d04fbd9224df7386d3ada8, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.357982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1298/2627] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:16.358119 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f606ef0-a187-47a6-aff6-6bc31f562adb admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.358221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdddf5b-0569-47f0-ac54-51001cf9ada2 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.370584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:16.421059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdddf5b-0569-47f0-ac54-51001cf9ada2 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.426774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85bbcb-ea90-42f7-b770-11d9335b0666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.427565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85bbcb-ea90-42f7-b770-11d9335b0666 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.427994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85bbcb-ea90-42f7-b770-11d9335b0666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.428416 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85bbcb-ea90-42f7-b770-11d9335b0666 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.429208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85bbcb-ea90-42f7-b770-11d9335b0666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.431282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85bbcb-ea90-42f7-b770-11d9335b0666 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.456555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1330/2628] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:16 2022] PUT /identity/v3/projects/02cdf96cb4fd42519f35d0fe325ce2c8/users/6b8d2ada97d04fbd9224df7386d3ada8/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:16.461607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadd04a-6688-4917-aa6a-ad498cf7b1bc None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.461906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadd04a-6688-4917-aa6a-ad498cf7b1bc None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.462192 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadd04a-6688-4917-aa6a-ad498cf7b1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.485061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:16.488470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-1dadd04a-6688-4917-aa6a-ad498cf7b1bc None None] MFA Rules not processed for user `6b8d2ada97d04fbd9224df7386d3ada8`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:16.489707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1dadd04a-6688-4917-aa6a-ad498cf7b1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:16.534405 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1299/2629] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:16.538410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85bbcb-ea90-42f7-b770-11d9335b0666 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.548372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85bbcb-ea90-42f7-b770-11d9335b0666 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.558331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1331/2630] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:16.569778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadd04a-6688-4917-aa6a-ad498cf7b1bc None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.571347 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1dadd04a-6688-4917-aa6a-ad498cf7b1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:16.620785 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8159bb0-3506-4949-ad7d-5b8863662efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.621716 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8159bb0-3506-4949-ad7d-5b8863662efb admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.622100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8159bb0-3506-4949-ad7d-5b8863662efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.622599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8159bb0-3506-4949-ad7d-5b8863662efb admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.623436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8159bb0-3506-4949-ad7d-5b8863662efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.625329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8159bb0-3506-4949-ad7d-5b8863662efb admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.641881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1300/2631] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:16.643622 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8159bb0-3506-4949-ad7d-5b8863662efb admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.657086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadd04a-6688-4917-aa6a-ad498cf7b1bc None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.661879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88e5b-4c0d-42db-883a-0f8f77ac5293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.663740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88e5b-4c0d-42db-883a-0f8f77ac5293 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.664040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88e5b-4c0d-42db-883a-0f8f77ac5293 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.664445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88e5b-4c0d-42db-883a-0f8f77ac5293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.667147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8159bb0-3506-4949-ad7d-5b8863662efb admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.675544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88e5b-4c0d-42db-883a-0f8f77ac5293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.676451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a362a9d-6c6b-4ffa-8ef1-a734aa79833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.677207 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362a9d-6c6b-4ffa-8ef1-a734aa79833b admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.678012 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362a9d-6c6b-4ffa-8ef1-a734aa79833b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.678363 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362a9d-6c6b-4ffa-8ef1-a734aa79833b admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.678586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88e5b-4c0d-42db-883a-0f8f77ac5293 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.679366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a362a9d-6c6b-4ffa-8ef1-a734aa79833b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.681070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a362a9d-6c6b-4ffa-8ef1-a734aa79833b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.689967 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1332/2632] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:16.711551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88e5b-4c0d-42db-883a-0f8f77ac5293 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:16.718309 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1301/2633] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:16.726320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88e5b-4c0d-42db-883a-0f8f77ac5293 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:16.731219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e63fa-144f-41e7-bf5c-a977cf2fd546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:16.732252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e63fa-144f-41e7-bf5c-a977cf2fd546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.732646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e63fa-144f-41e7-bf5c-a977cf2fd546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.732996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e63fa-144f-41e7-bf5c-a977cf2fd546 admin admin] PATH_INFO: `/v3/projects/74d4b6fb957a44efa28cde4c0f7279eb/users/2822464c43c54dbe9805d484b2a6ba91/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.755010 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e63fa-144f-41e7-bf5c-a977cf2fd546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d4b6fb957a44efa28cde4c0f7279eb, user_id=2822464c43c54dbe9805d484b2a6ba91, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:16.757740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e63fa-144f-41e7-bf5c-a977cf2fd546 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:16.820597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1333/2634] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:16 2022] PUT /identity/v3/projects/74d4b6fb957a44efa28cde4c0f7279eb/users/2822464c43c54dbe9805d484b2a6ba91/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:16.831554 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31fa66-66cf-406b-8f03-8bff0cfff36a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:16.831895 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31fa66-66cf-406b-8f03-8bff0cfff36a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:16.832113 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31fa66-66cf-406b-8f03-8bff0cfff36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:16.864574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7c31fa66-66cf-406b-8f03-8bff0cfff36a None None] MFA Rules not processed for user `2822464c43c54dbe9805d484b2a6ba91`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:16.866192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7c31fa66-66cf-406b-8f03-8bff0cfff36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:16.952904 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1302/2635] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:16.958453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e63fa-144f-41e7-bf5c-a977cf2fd546 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.028516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e63fa-144f-41e7-bf5c-a977cf2fd546 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.033261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382daaa-488a-4f5a-bb30-506715d08bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.034328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382daaa-488a-4f5a-bb30-506715d08bda admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.034620 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382daaa-488a-4f5a-bb30-506715d08bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.034901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382daaa-488a-4f5a-bb30-506715d08bda admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.035604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382daaa-488a-4f5a-bb30-506715d08bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.037815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382daaa-488a-4f5a-bb30-506715d08bda admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.132020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1334/2636] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:16 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:17.136134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31fa66-66cf-406b-8f03-8bff0cfff36a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.148114 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31fa66-66cf-406b-8f03-8bff0cfff36a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.161020 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:17.206650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11d04-7c9b-407b-a961-54754dc543c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.207252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11d04-7c9b-407b-a961-54754dc543c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.207796 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11d04-7c9b-407b-a961-54754dc543c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.208073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11d04-7c9b-407b-a961-54754dc543c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.208797 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e11d04-7c9b-407b-a961-54754dc543c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.210736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e11d04-7c9b-407b-a961-54754dc543c9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.293048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1303/2637] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:17 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:17.297194 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382daaa-488a-4f5a-bb30-506715d08bda admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.308703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382daaa-488a-4f5a-bb30-506715d08bda admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.313313 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804044d6-534e-40ac-9957-f8d7d9500dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.314248 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804044d6-534e-40ac-9957-f8d7d9500dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.314532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804044d6-534e-40ac-9957-f8d7d9500dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.314816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804044d6-534e-40ac-9957-f8d7d9500dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.316420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804044d6-534e-40ac-9957-f8d7d9500dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.318201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804044d6-534e-40ac-9957-f8d7d9500dcf admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.319746 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:17.332823 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1335/2638] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:17.334286 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11d04-7c9b-407b-a961-54754dc543c9 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.344378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11d04-7c9b-407b-a961-54754dc543c9 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.350224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2b082-10c5-407e-b1fb-14ba90701cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.350914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2b082-10c5-407e-b1fb-14ba90701cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.351594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2b082-10c5-407e-b1fb-14ba90701cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.351594 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2b082-10c5-407e-b1fb-14ba90701cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.352170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2b082-10c5-407e-b1fb-14ba90701cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.354386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2b082-10c5-407e-b1fb-14ba90701cb0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.367584 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1304/2639] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:17.373053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804044d6-534e-40ac-9957-f8d7d9500dcf admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.383733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804044d6-534e-40ac-9957-f8d7d9500dcf admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.388853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908e7ea-c3f3-43e0-b428-2b53e4357619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.389760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e7ea-c3f3-43e0-b428-2b53e4357619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.390078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e7ea-c3f3-43e0-b428-2b53e4357619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.392649 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e7ea-c3f3-43e0-b428-2b53e4357619 admin admin] PATH_INFO: `/v3/projects/0e5bd1ae48a148d993a8d68b1a0d4951/users/4b7c4e434a4441a5a73607bdac34cc95/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.405484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908e7ea-c3f3-43e0-b428-2b53e4357619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5bd1ae48a148d993a8d68b1a0d4951, user_id=4b7c4e434a4441a5a73607bdac34cc95, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.408146 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908e7ea-c3f3-43e0-b428-2b53e4357619 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.545152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1336/2640] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:17 2022] PUT /identity/v3/projects/0e5bd1ae48a148d993a8d68b1a0d4951/users/4b7c4e434a4441a5a73607bdac34cc95/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:17.557218 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d471-0e7f-40bd-9fe2-f1b29543f577 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.557750 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d471-0e7f-40bd-9fe2-f1b29543f577 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.557875 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d471-0e7f-40bd-9fe2-f1b29543f577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.595143 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8250d471-0e7f-40bd-9fe2-f1b29543f577 None None] MFA Rules not processed for user `4b7c4e434a4441a5a73607bdac34cc95`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:17.597364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8250d471-0e7f-40bd-9fe2-f1b29543f577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:17.671681 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1305/2641] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:17.677034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908e7ea-c3f3-43e0-b428-2b53e4357619 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.744515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908e7ea-c3f3-43e0-b428-2b53e4357619 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.751088 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fa867-0830-4c33-aaed-beb2e0b2f4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.751764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa867-0830-4c33-aaed-beb2e0b2f4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.752053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa867-0830-4c33-aaed-beb2e0b2f4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.752560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa867-0830-4c33-aaed-beb2e0b2f4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.753284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fa867-0830-4c33-aaed-beb2e0b2f4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.755483 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fa867-0830-4c33-aaed-beb2e0b2f4b8 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:17.868670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1337/2642] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:17 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:17.873027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d471-0e7f-40bd-9fe2-f1b29543f577 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:17.885039 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d471-0e7f-40bd-9fe2-f1b29543f577 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:17.944412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9c733-4eb9-446f-8e77-0ba27df75e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:17.945083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9c733-4eb9-446f-8e77-0ba27df75e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:17.945366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9c733-4eb9-446f-8e77-0ba27df75e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:17.945640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9c733-4eb9-446f-8e77-0ba27df75e44 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:17.946332 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9c733-4eb9-446f-8e77-0ba27df75e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:17.948344 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9c733-4eb9-446f-8e77-0ba27df75e44 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.056003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1306/2643] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:17 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:18.057205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fa867-0830-4c33-aaed-beb2e0b2f4b8 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:18.068225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fa867-0830-4c33-aaed-beb2e0b2f4b8 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:18.073063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23657f2d-b449-408a-863c-071e64f03061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.073701 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23657f2d-b449-408a-863c-071e64f03061 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.073985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23657f2d-b449-408a-863c-071e64f03061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.074263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23657f2d-b449-408a-863c-071e64f03061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.076046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23657f2d-b449-408a-863c-071e64f03061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.077754 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23657f2d-b449-408a-863c-071e64f03061 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.090244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1338/2644] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:18.094495 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9c733-4eb9-446f-8e77-0ba27df75e44 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:18.105788 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9c733-4eb9-446f-8e77-0ba27df75e44 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:18.110508 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1a690-2ec6-4120-ae11-6261073bd6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.111388 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1a690-2ec6-4120-ae11-6261073bd6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.114601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1a690-2ec6-4120-ae11-6261073bd6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.114965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1a690-2ec6-4120-ae11-6261073bd6c3 admin admin] PATH_INFO: `/v3/projects/56bce4cef76e48b1af71d9cd51287556/users/adbe02fa02b344a0ad5d3ee99a121087/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.127689 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:18.130845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1a690-2ec6-4120-ae11-6261073bd6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bce4cef76e48b1af71d9cd51287556, user_id=adbe02fa02b344a0ad5d3ee99a121087, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.133610 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1a690-2ec6-4120-ae11-6261073bd6c3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.232187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1307/2645] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:18 2022] PUT /identity/v3/projects/56bce4cef76e48b1af71d9cd51287556/users/adbe02fa02b344a0ad5d3ee99a121087/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:18.235933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23657f2d-b449-408a-863c-071e64f03061 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:18.246554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23657f2d-b449-408a-863c-071e64f03061 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:18.314689 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d18ed8-473d-43aa-a75b-1c699e0cfb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.315286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d18ed8-473d-43aa-a75b-1c699e0cfb25 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.315572 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d18ed8-473d-43aa-a75b-1c699e0cfb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.315855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d18ed8-473d-43aa-a75b-1c699e0cfb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.316649 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d18ed8-473d-43aa-a75b-1c699e0cfb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.318311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d18ed8-473d-43aa-a75b-1c699e0cfb25 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.333046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1339/2646] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:18.334275 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1a690-2ec6-4120-ae11-6261073bd6c3 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:18.347983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1a690-2ec6-4120-ae11-6261073bd6c3 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:18.352897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4535872-6edd-42fc-b72d-f3a8283d7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.353862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4535872-6edd-42fc-b72d-f3a8283d7c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.354214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4535872-6edd-42fc-b72d-f3a8283d7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.354556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4535872-6edd-42fc-b72d-f3a8283d7c80 admin admin] PATH_INFO: `/v3/projects/56bce4cef76e48b1af71d9cd51287556/users/adbe02fa02b344a0ad5d3ee99a121087/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.356643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4535872-6edd-42fc-b72d-f3a8283d7c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bce4cef76e48b1af71d9cd51287556, user_id=adbe02fa02b344a0ad5d3ee99a121087, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.359475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4535872-6edd-42fc-b72d-f3a8283d7c80 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.370914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1308/2647] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:18 2022] PUT /identity/v3/projects/56bce4cef76e48b1af71d9cd51287556/users/adbe02fa02b344a0ad5d3ee99a121087/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:18.385348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7b5db-e84d-44e9-92a8-a52266339ac1 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.385640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7b5db-e84d-44e9-92a8-a52266339ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.385914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7b5db-e84d-44e9-92a8-a52266339ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.413907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-e1e7b5db-e84d-44e9-92a8-a52266339ac1 None None] MFA Rules not processed for user `adbe02fa02b344a0ad5d3ee99a121087`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:18.415133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e1e7b5db-e84d-44e9-92a8-a52266339ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:18.446070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:18.485374 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1340/2648] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:18.498616 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4535872-6edd-42fc-b72d-f3a8283d7c80 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:18.570333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4535872-6edd-42fc-b72d-f3a8283d7c80 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:18.574271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa309211-5965-4917-80c7-3734f6495d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.574924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa309211-5965-4917-80c7-3734f6495d00 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.575208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa309211-5965-4917-80c7-3734f6495d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.575486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa309211-5965-4917-80c7-3734f6495d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.586350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa309211-5965-4917-80c7-3734f6495d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.591812 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa309211-5965-4917-80c7-3734f6495d00 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.602562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1309/2649] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:18.738485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7b5db-e84d-44e9-92a8-a52266339ac1 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:18.755799 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7b5db-e84d-44e9-92a8-a52266339ac1 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:18.760944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f07b9-e513-4a3c-b284-8056d8c207d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:18.762934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f07b9-e513-4a3c-b284-8056d8c207d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:18.764220 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f07b9-e513-4a3c-b284-8056d8c207d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:18.764571 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f07b9-e513-4a3c-b284-8056d8c207d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:18.860358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f07b9-e513-4a3c-b284-8056d8c207d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:18.862222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f07b9-e513-4a3c-b284-8056d8c207d6 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:18.873811 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1341/2650] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:19.482246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa309211-5965-4917-80c7-3734f6495d00 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:19.483928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fa309211-5965-4917-80c7-3734f6495d00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:19.560093 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa309211-5965-4917-80c7-3734f6495d00 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:19.564763 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:19.565676 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:19.568264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:19.568264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] PATH_INFO: `/v3/users/29e2a2fa32cd4fb7837bdec1d83cb9da` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:19.580128 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e2a2fa32cd4fb7837bdec1d83cb9da)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:19.582869 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:19.751743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e2a2fa32cd4fb7837bdec1d83cb9da'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:19.752432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e2a2fa32cd4fb7837bdec1d83cb9da'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:19.759425 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e2a2fa32cd4fb7837bdec1d83cb9da'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:19.770790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:19.775621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e2a2fa32cd4fb7837bdec1d83cb9da'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:19.853107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6017b5e4-cc41-4535-9bb9-3957fdc9e7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e2a2fa32cd4fb7837bdec1d83cb9da'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:19.859712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1310/2651] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:19 2022] DELETE /identity/v3/users/29e2a2fa32cd4fb7837bdec1d83cb9da => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:20.117038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f07b9-e513-4a3c-b284-8056d8c207d6 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.129671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f07b9-e513-4a3c-b284-8056d8c207d6 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.187838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.188733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.189021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.189300 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] PATH_INFO: `/v3/projects/60f9f16bd2494b7999c25509f804d794` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.200460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f9f16bd2494b7999c25509f804d794)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.203208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.303977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f9f16bd2494b7999c25509f804d794', 'request_id': 'req-35e86c21-ccf2-499e-b4fe-ced83e923bef'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:20.309821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f9f16bd2494b7999c25509f804d794', 'request_id': 'req-35e86c21-ccf2-499e-b4fe-ced83e923bef'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:20.311476 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:20.379124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f9f16bd2494b7999c25509f804d794', 'request_id': 'req-35e86c21-ccf2-499e-b4fe-ced83e923bef'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:20.392638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] The token cache is being invalidate because project 60f9f16bd2494b7999c25509f804d794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:20.392638 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:20.394700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-35e86c21-ccf2-499e-b4fe-ced83e923bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:20.400860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1342/2652] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:20 2022] DELETE /identity/v3/projects/60f9f16bd2494b7999c25509f804d794 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:20.401949 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519fbcd-c9d9-4277-a89e-f405dd585022 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.402253 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519fbcd-c9d9-4277-a89e-f405dd585022 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.402540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519fbcd-c9d9-4277-a89e-f405dd585022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.433331 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-6519fbcd-c9d9-4277-a89e-f405dd585022 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:20.434580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6519fbcd-c9d9-4277-a89e-f405dd585022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:20.507726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1311/2653] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:20.516183 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9f70b-a436-4f5f-8159-0b46bb699c8c None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.516512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9f70b-a436-4f5f-8159-0b46bb699c8c None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.516797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9f70b-a436-4f5f-8159-0b46bb699c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.534884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-dfe9f70b-a436-4f5f-8159-0b46bb699c8c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:20.536095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-dfe9f70b-a436-4f5f-8159-0b46bb699c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:20.544199 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1343/2654] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:20.549003 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519fbcd-c9d9-4277-a89e-f405dd585022 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.559599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519fbcd-c9d9-4277-a89e-f405dd585022 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.564192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61fd9-fd92-4713-8ff2-aa639a8cfe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.564873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61fd9-fd92-4713-8ff2-aa639a8cfe75 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.565793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61fd9-fd92-4713-8ff2-aa639a8cfe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.566065 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61fd9-fd92-4713-8ff2-aa639a8cfe75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.566787 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61fd9-fd92-4713-8ff2-aa639a8cfe75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:20.567095 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61fd9-fd92-4713-8ff2-aa639a8cfe75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.568727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61fd9-fd92-4713-8ff2-aa639a8cfe75 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.580104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1312/2655] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:20.584772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9f70b-a436-4f5f-8159-0b46bb699c8c None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.593981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9f70b-a436-4f5f-8159-0b46bb699c8c None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.599203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219225db-458d-41bf-b484-273d003abefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.599874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219225db-458d-41bf-b484-273d003abefb admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.600158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219225db-458d-41bf-b484-273d003abefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.600462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219225db-458d-41bf-b484-273d003abefb admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.601160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219225db-458d-41bf-b484-273d003abefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.603117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219225db-458d-41bf-b484-273d003abefb admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.717253 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1344/2656] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:20 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:20.723534 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61fd9-fd92-4713-8ff2-aa639a8cfe75 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.733924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61fd9-fd92-4713-8ff2-aa639a8cfe75 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.793325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279af2-b99b-4c21-8dbf-3c4bc433f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.794092 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279af2-b99b-4c21-8dbf-3c4bc433f698 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.794379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279af2-b99b-4c21-8dbf-3c4bc433f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.794663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279af2-b99b-4c21-8dbf-3c4bc433f698 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.795351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef279af2-b99b-4c21-8dbf-3c4bc433f698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.797315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef279af2-b99b-4c21-8dbf-3c4bc433f698 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.886914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1313/2657] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:20 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:20.891005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219225db-458d-41bf-b484-273d003abefb admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.901802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219225db-458d-41bf-b484-273d003abefb admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.906912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15711445-9e51-45f2-ad59-570b12c7256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.907607 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15711445-9e51-45f2-ad59-570b12c7256d admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.907859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15711445-9e51-45f2-ad59-570b12c7256d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.908492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15711445-9e51-45f2-ad59-570b12c7256d admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.909781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15711445-9e51-45f2-ad59-570b12c7256d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.911512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15711445-9e51-45f2-ad59-570b12c7256d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.923855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1345/2658] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:20.928993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279af2-b99b-4c21-8dbf-3c4bc433f698 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.942982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279af2-b99b-4c21-8dbf-3c4bc433f698 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.948898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b6463-1b71-43f5-9159-c4e9474f9f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.949577 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6463-1b71-43f5-9159-c4e9474f9f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.950154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6463-1b71-43f5-9159-c4e9474f9f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.950154 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6463-1b71-43f5-9159-c4e9474f9f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:20.950844 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b6463-1b71-43f5-9159-c4e9474f9f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:20.952542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b6463-1b71-43f5-9159-c4e9474f9f21 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:20.969671 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1314/2659] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:20.972725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15711445-9e51-45f2-ad59-570b12c7256d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:20.993956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15711445-9e51-45f2-ad59-570b12c7256d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:20.993956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c41c7c-1262-4f55-b5e0-3e064cdde9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:20.993956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c41c7c-1262-4f55-b5e0-3e064cdde9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:20.993956 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c41c7c-1262-4f55-b5e0-3e064cdde9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:20.994599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c41c7c-1262-4f55-b5e0-3e064cdde9b9 admin admin] PATH_INFO: `/v3/projects/f31f732170f54620aaec290a37a6d829/users/f8c8686de96e4247a8c7eaded489b54f/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.015008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c41c7c-1262-4f55-b5e0-3e064cdde9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31f732170f54620aaec290a37a6d829, user_id=f8c8686de96e4247a8c7eaded489b54f, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.017760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c41c7c-1262-4f55-b5e0-3e064cdde9b9 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.115941 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1346/2660] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:20 2022] PUT /identity/v3/projects/f31f732170f54620aaec290a37a6d829/users/f8c8686de96e4247a8c7eaded489b54f/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:21.126609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc45c-c658-4f4b-9a63-37c244f5839a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.132375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc45c-c658-4f4b-9a63-37c244f5839a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.132375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc45c-c658-4f4b-9a63-37c244f5839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.157486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0abdc45c-c658-4f4b-9a63-37c244f5839a None None] MFA Rules not processed for user `f8c8686de96e4247a8c7eaded489b54f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:21.157486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0abdc45c-c658-4f4b-9a63-37c244f5839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:21.201576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:21.228097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1315/2661] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:21.239699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c41c7c-1262-4f55-b5e0-3e064cdde9b9 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:21.241641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-28c41c7c-1262-4f55-b5e0-3e064cdde9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:21.316904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c41c7c-1262-4f55-b5e0-3e064cdde9b9 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:21.322740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466f722-7ef3-4497-bab3-6ae40db4269f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:21.323389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f722-7ef3-4497-bab3-6ae40db4269f service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:21.323680 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f722-7ef3-4497-bab3-6ae40db4269f service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:21.324021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f722-7ef3-4497-bab3-6ae40db4269f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:21.332808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466f722-7ef3-4497-bab3-6ae40db4269f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:21.335410 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466f722-7ef3-4497-bab3-6ae40db4269f service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:21.343268 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1347/2662] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:22.873045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdc45c-c658-4f4b-9a63-37c244f5839a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:22.874526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0abdc45c-c658-4f4b-9a63-37c244f5839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:22.946891 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdc45c-c658-4f4b-9a63-37c244f5839a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:22.951761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:22.952673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:22.952959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:22.953236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] PATH_INFO: `/v3/users/2822464c43c54dbe9805d484b2a6ba91` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:22.954491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2822464c43c54dbe9805d484b2a6ba91)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:22.957882 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:23.136479 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2822464c43c54dbe9805d484b2a6ba91'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:23.137356 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2822464c43c54dbe9805d484b2a6ba91'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:23.151608 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2822464c43c54dbe9805d484b2a6ba91'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:23.165735 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2822464c43c54dbe9805d484b2a6ba91'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:23.223599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2822464c43c54dbe9805d484b2a6ba91'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:23.230263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1316/2663] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:22 2022] DELETE /identity/v3/users/2822464c43c54dbe9805d484b2a6ba91 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:23.235007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42356af-78ca-4196-9be3-c5324f877ec8 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:23.235470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42356af-78ca-4196-9be3-c5324f877ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:23.235470 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42356af-78ca-4196-9be3-c5324f877ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:23.253955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d42356af-78ca-4196-9be3-c5324f877ec8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:23.255174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d42356af-78ca-4196-9be3-c5324f877ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:23.319139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1348/2664] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:23.328706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:23.330224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:23.397121 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e084cf-8526-4df5-a973-3f66a1731a03 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:23.399343 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7ffd2-1cff-4600-95bb-2283b875cd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:23.399992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7ffd2-1cff-4600-95bb-2283b875cd27 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:23.400279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7ffd2-1cff-4600-95bb-2283b875cd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:23.400596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7ffd2-1cff-4600-95bb-2283b875cd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:23.409799 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7ffd2-1cff-4600-95bb-2283b875cd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:23.411284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7ffd2-1cff-4600-95bb-2283b875cd27 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:23.422434 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1317/2665] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:23.811134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42356af-78ca-4196-9be3-c5324f877ec8 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:23.812946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d42356af-78ca-4196-9be3-c5324f877ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:23.828235 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42356af-78ca-4196-9be3-c5324f877ec8 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:23.835730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:23.837121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:23.837330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:23.837668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] PATH_INFO: `/v3/projects/74d4b6fb957a44efa28cde4c0f7279eb` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:23.838802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d4b6fb957a44efa28cde4c0f7279eb)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:23.840860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:23.849228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:23.936374 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d4b6fb957a44efa28cde4c0f7279eb', 'request_id': 'req-dcf49149-b021-4549-b618-06a85119924d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:23.942244 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d4b6fb957a44efa28cde4c0f7279eb', 'request_id': 'req-dcf49149-b021-4549-b618-06a85119924d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:24.006272 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d4b6fb957a44efa28cde4c0f7279eb', 'request_id': 'req-dcf49149-b021-4549-b618-06a85119924d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:24.021169 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] The token cache is being invalidate because project 74d4b6fb957a44efa28cde4c0f7279eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:24.021381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:24.022026 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:24.023623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1349/2666] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:23 2022] DELETE /identity/v3/projects/74d4b6fb957a44efa28cde4c0f7279eb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:24.027550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7ffd2-1cff-4600-95bb-2283b875cd27 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:24.038774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7ffd2-1cff-4600-95bb-2283b875cd27 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:24.048153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:24.102564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:24.103740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:24.104019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:24.104315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] PATH_INFO: `/v3/users/4b7c4e434a4441a5a73607bdac34cc95` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:24.105524 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7c4e434a4441a5a73607bdac34cc95)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:24.107519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:24.335650 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7c4e434a4441a5a73607bdac34cc95'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:24.336396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7c4e434a4441a5a73607bdac34cc95'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:24.343125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7c4e434a4441a5a73607bdac34cc95'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:24.355972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7c4e434a4441a5a73607bdac34cc95'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:24.411964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7c4e434a4441a5a73607bdac34cc95'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:24.418492 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1318/2667] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:24 2022] DELETE /identity/v3/users/4b7c4e434a4441a5a73607bdac34cc95 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:24.825411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:24.826883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:24.847839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf49149-b021-4549-b618-06a85119924d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:24.907181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:24.908077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:24.908386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:24.908694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] PATH_INFO: `/v3/projects/0e5bd1ae48a148d993a8d68b1a0d4951` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:24.910025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5bd1ae48a148d993a8d68b1a0d4951)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:24.911949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:25.012487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5bd1ae48a148d993a8d68b1a0d4951', 'request_id': 'req-897dba68-b1ba-4a68-918d-6728a7c2c9a4'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.018130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5bd1ae48a148d993a8d68b1a0d4951', 'request_id': 'req-897dba68-b1ba-4a68-918d-6728a7c2c9a4'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.109151 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5bd1ae48a148d993a8d68b1a0d4951', 'request_id': 'req-897dba68-b1ba-4a68-918d-6728a7c2c9a4'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.122024 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] The token cache is being invalidate because project 0e5bd1ae48a148d993a8d68b1a0d4951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:25.122318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.122989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.124611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1350/2668] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:24 2022] DELETE /identity/v3/projects/0e5bd1ae48a148d993a8d68b1a0d4951 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:25.128658 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:25.130069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:25.142504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82a94f-d6dc-4bbf-ba1e-0bdd7e72ef0d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:25.202149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:25.203022 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:25.203301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:25.203575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] PATH_INFO: `/v3/users/adbe02fa02b344a0ad5d3ee99a121087` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:25.204836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbe02fa02b344a0ad5d3ee99a121087)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:25.206896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:25.328074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:25.402298 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbe02fa02b344a0ad5d3ee99a121087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.402872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbe02fa02b344a0ad5d3ee99a121087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.410707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbe02fa02b344a0ad5d3ee99a121087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.422055 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbe02fa02b344a0ad5d3ee99a121087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.463570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-97c0923e-febf-48e5-93ed-136a0ed63a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbe02fa02b344a0ad5d3ee99a121087'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:25.469883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1319/2669] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:25 2022] DELETE /identity/v3/users/adbe02fa02b344a0ad5d3ee99a121087 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:25.901078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:25.902548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:25.915869 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dba68-b1ba-4a68-918d-6728a7c2c9a4 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:25.936468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:25.977035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:25.977839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:25.978125 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:25.978404 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] PATH_INFO: `/v3/projects/56bce4cef76e48b1af71d9cd51287556` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:25.979578 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56bce4cef76e48b1af71d9cd51287556)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:25.981540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.081740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56bce4cef76e48b1af71d9cd51287556', 'request_id': 'req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:26.087805 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56bce4cef76e48b1af71d9cd51287556', 'request_id': 'req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:26.137506 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56bce4cef76e48b1af71d9cd51287556', 'request_id': 'req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:26.149944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] The token cache is being invalidate because project 56bce4cef76e48b1af71d9cd51287556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:26.150238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:26.150929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-57c7cb03-c1d7-4d4d-b2e3-0f28ea2e16a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:26.152525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1351/2670] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:25 2022] DELETE /identity/v3/projects/56bce4cef76e48b1af71d9cd51287556 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:26.158623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bfd48-a381-40cf-a9f4-267e95c00099 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.159270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bfd48-a381-40cf-a9f4-267e95c00099 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.159630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bfd48-a381-40cf-a9f4-267e95c00099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.178127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0d3bfd48-a381-40cf-a9f4-267e95c00099 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:26.179372 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0d3bfd48-a381-40cf-a9f4-267e95c00099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:26.247108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1320/2671] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:26.256496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98aac3-9f99-49db-9c24-60a202e17ff7 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.256790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98aac3-9f99-49db-9c24-60a202e17ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.257070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98aac3-9f99-49db-9c24-60a202e17ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.276445 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-1e98aac3-9f99-49db-9c24-60a202e17ff7 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:26.277664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1e98aac3-9f99-49db-9c24-60a202e17ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:26.286397 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1352/2672] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:26.290582 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bfd48-a381-40cf-a9f4-267e95c00099 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.301406 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bfd48-a381-40cf-a9f4-267e95c00099 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.306048 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3bf6e-4565-4a3f-b19d-9c796edba2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.306700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3bf6e-4565-4a3f-b19d-9c796edba2be admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.306982 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3bf6e-4565-4a3f-b19d-9c796edba2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.307258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3bf6e-4565-4a3f-b19d-9c796edba2be admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.307989 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3bf6e-4565-4a3f-b19d-9c796edba2be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:26.308316 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3bf6e-4565-4a3f-b19d-9c796edba2be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.309924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3bf6e-4565-4a3f-b19d-9c796edba2be admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.322687 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1321/2673] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:26.328232 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98aac3-9f99-49db-9c24-60a202e17ff7 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.338082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98aac3-9f99-49db-9c24-60a202e17ff7 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.342693 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4acc2a-914c-4bef-8f5f-433b87fbbc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.343338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4acc2a-914c-4bef-8f5f-433b87fbbc23 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.343623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4acc2a-914c-4bef-8f5f-433b87fbbc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.343900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4acc2a-914c-4bef-8f5f-433b87fbbc23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.344637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4acc2a-914c-4bef-8f5f-433b87fbbc23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.346598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4acc2a-914c-4bef-8f5f-433b87fbbc23 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.419324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1353/2674] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:26 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:26.423795 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3bf6e-4565-4a3f-b19d-9c796edba2be admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.434980 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3bf6e-4565-4a3f-b19d-9c796edba2be admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.493928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022543-f506-4a0e-8df7-3a0f3cc58cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.494597 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022543-f506-4a0e-8df7-3a0f3cc58cca admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.494877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022543-f506-4a0e-8df7-3a0f3cc58cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.495150 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022543-f506-4a0e-8df7-3a0f3cc58cca admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.495846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57022543-f506-4a0e-8df7-3a0f3cc58cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.500842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57022543-f506-4a0e-8df7-3a0f3cc58cca admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.596031 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1322/2675] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:26 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:26.596695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4acc2a-914c-4bef-8f5f-433b87fbbc23 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.605631 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4acc2a-914c-4bef-8f5f-433b87fbbc23 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.610231 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8e828-1e6b-4ded-881b-ecbd30145dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.610882 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8e828-1e6b-4ded-881b-ecbd30145dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.611162 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8e828-1e6b-4ded-881b-ecbd30145dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.611436 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8e828-1e6b-4ded-881b-ecbd30145dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.612829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8e828-1e6b-4ded-881b-ecbd30145dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.614500 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8e828-1e6b-4ded-881b-ecbd30145dbb admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.624927 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1354/2676] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:26.633342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022543-f506-4a0e-8df7-3a0f3cc58cca admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.643359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022543-f506-4a0e-8df7-3a0f3cc58cca admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.647975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfe483-ba19-4f46-b1ac-3ea4f111c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.648661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe483-ba19-4f46-b1ac-3ea4f111c0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.648942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe483-ba19-4f46-b1ac-3ea4f111c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.649214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe483-ba19-4f46-b1ac-3ea4f111c0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.649928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfe483-ba19-4f46-b1ac-3ea4f111c0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.651559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfe483-ba19-4f46-b1ac-3ea4f111c0a5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.662197 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1323/2677] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:26.666494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8e828-1e6b-4ded-881b-ecbd30145dbb admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.677393 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8e828-1e6b-4ded-881b-ecbd30145dbb admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.681994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51161f5d-8d28-477a-960e-4a0bd16e2b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.682961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51161f5d-8d28-477a-960e-4a0bd16e2b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.683280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51161f5d-8d28-477a-960e-4a0bd16e2b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.683560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51161f5d-8d28-477a-960e-4a0bd16e2b80 admin admin] PATH_INFO: `/v3/projects/cf10412d9454423c805ff1e827c8e720/users/ec52576ff58343d9a79727e85bcda4ba/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.699505 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51161f5d-8d28-477a-960e-4a0bd16e2b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf10412d9454423c805ff1e827c8e720, user_id=ec52576ff58343d9a79727e85bcda4ba, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.702283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51161f5d-8d28-477a-960e-4a0bd16e2b80 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:26.777580 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1355/2678] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:26 2022] PUT /identity/v3/projects/cf10412d9454423c805ff1e827c8e720/users/ec52576ff58343d9a79727e85bcda4ba/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:26.789062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe46df5-42b0-443e-86c2-2cd835d9ae87 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.792825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe46df5-42b0-443e-86c2-2cd835d9ae87 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.792825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe46df5-42b0-443e-86c2-2cd835d9ae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.809657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:26.817109 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-5fe46df5-42b0-443e-86c2-2cd835d9ae87 None None] MFA Rules not processed for user `ec52576ff58343d9a79727e85bcda4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:26.821556 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-5fe46df5-42b0-443e-86c2-2cd835d9ae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:26.884182 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1324/2679] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:26.888662 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51161f5d-8d28-477a-960e-4a0bd16e2b80 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:26.937138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:26.950207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51161f5d-8d28-477a-960e-4a0bd16e2b80 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:26.954920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839179a-368a-4521-bf85-bc7345ccd0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:26.955735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839179a-368a-4521-bf85-bc7345ccd0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:26.956025 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839179a-368a-4521-bf85-bc7345ccd0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:26.956318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839179a-368a-4521-bf85-bc7345ccd0b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:26.957043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839179a-368a-4521-bf85-bc7345ccd0b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:26.959203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839179a-368a-4521-bf85-bc7345ccd0b9 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.042457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1356/2680] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:26 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:27.046409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe46df5-42b0-443e-86c2-2cd835d9ae87 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.057549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe46df5-42b0-443e-86c2-2cd835d9ae87 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.113956 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605fa4e-97e0-4cc6-98ca-8ee37426c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.114630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605fa4e-97e0-4cc6-98ca-8ee37426c125 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.114919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605fa4e-97e0-4cc6-98ca-8ee37426c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.115193 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605fa4e-97e0-4cc6-98ca-8ee37426c125 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.115872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605fa4e-97e0-4cc6-98ca-8ee37426c125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:27.117842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605fa4e-97e0-4cc6-98ca-8ee37426c125 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.276529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1325/2681] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:27 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:27.280540 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839179a-368a-4521-bf85-bc7345ccd0b9 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.291399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839179a-368a-4521-bf85-bc7345ccd0b9 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.295954 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479a002-6c45-4ffb-8814-b81e7ff9e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.296613 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479a002-6c45-4ffb-8814-b81e7ff9e901 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.296896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479a002-6c45-4ffb-8814-b81e7ff9e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.297171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479a002-6c45-4ffb-8814-b81e7ff9e901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.297897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479a002-6c45-4ffb-8814-b81e7ff9e901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:27.299525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479a002-6c45-4ffb-8814-b81e7ff9e901 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.311114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1357/2682] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:27.315024 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605fa4e-97e0-4cc6-98ca-8ee37426c125 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.325270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605fa4e-97e0-4cc6-98ca-8ee37426c125 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.329881 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72756bf4-e0ad-4fb6-b35f-e92a831514b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.331310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72756bf4-e0ad-4fb6-b35f-e92a831514b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.331601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72756bf4-e0ad-4fb6-b35f-e92a831514b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.331876 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72756bf4-e0ad-4fb6-b35f-e92a831514b8 admin admin] PATH_INFO: `/v3/projects/13d4a964acc34f95be809a19f3386cd0/users/2f20cb8c4f6d487fbd54383b3194e387/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.347452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72756bf4-e0ad-4fb6-b35f-e92a831514b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d4a964acc34f95be809a19f3386cd0, user_id=2f20cb8c4f6d487fbd54383b3194e387, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:27.350165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72756bf4-e0ad-4fb6-b35f-e92a831514b8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.464079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1326/2683] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:27 2022] PUT /identity/v3/projects/13d4a964acc34f95be809a19f3386cd0/users/2f20cb8c4f6d487fbd54383b3194e387/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:27.468167 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479a002-6c45-4ffb-8814-b81e7ff9e901 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.478466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479a002-6c45-4ffb-8814-b81e7ff9e901 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.536073 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c7be8-7de1-4649-8db2-0d79f8091623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.536756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c7be8-7de1-4649-8db2-0d79f8091623 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.537045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c7be8-7de1-4649-8db2-0d79f8091623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.537318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c7be8-7de1-4649-8db2-0d79f8091623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.538064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c7be8-7de1-4649-8db2-0d79f8091623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:27.539661 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c7be8-7de1-4649-8db2-0d79f8091623 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.549851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1358/2684] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:27.554155 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72756bf4-e0ad-4fb6-b35f-e92a831514b8 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.564415 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72756bf4-e0ad-4fb6-b35f-e92a831514b8 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.569335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33d973-6cbb-43af-9230-df78a613e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.570208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33d973-6cbb-43af-9230-df78a613e66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.570496 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33d973-6cbb-43af-9230-df78a613e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.570776 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33d973-6cbb-43af-9230-df78a613e66e admin admin] PATH_INFO: `/v3/projects/13d4a964acc34f95be809a19f3386cd0/users/2f20cb8c4f6d487fbd54383b3194e387/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.572780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33d973-6cbb-43af-9230-df78a613e66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d4a964acc34f95be809a19f3386cd0, user_id=2f20cb8c4f6d487fbd54383b3194e387, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:27.575429 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33d973-6cbb-43af-9230-df78a613e66e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.586299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1327/2685] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:27 2022] PUT /identity/v3/projects/13d4a964acc34f95be809a19f3386cd0/users/2f20cb8c4f6d487fbd54383b3194e387/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:27.597163 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cacd09-a611-4114-819b-532124211571 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.597309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cacd09-a611-4114-819b-532124211571 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.597496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cacd09-a611-4114-819b-532124211571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.624596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b7cacd09-a611-4114-819b-532124211571 None None] MFA Rules not processed for user `2f20cb8c4f6d487fbd54383b3194e387`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:27.626326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b7cacd09-a611-4114-819b-532124211571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:27.694072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1359/2686] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:27.705872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33d973-6cbb-43af-9230-df78a613e66e admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.708116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-eb33d973-6cbb-43af-9230-df78a613e66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:27.764897 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33d973-6cbb-43af-9230-df78a613e66e admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.769042 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cdc39-2e6a-454d-8916-a7bb7e9c9f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.769675 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cdc39-2e6a-454d-8916-a7bb7e9c9f5f service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.769953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cdc39-2e6a-454d-8916-a7bb7e9c9f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.770225 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cdc39-2e6a-454d-8916-a7bb7e9c9f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.777244 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:27.779351 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cdc39-2e6a-454d-8916-a7bb7e9c9f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:27.780822 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cdc39-2e6a-454d-8916-a7bb7e9c9f5f service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:27.790903 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1328/2687] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:27.927503 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cacd09-a611-4114-819b-532124211571 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:27.928934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b7cacd09-a611-4114-819b-532124211571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:27.941239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cacd09-a611-4114-819b-532124211571 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:27.944777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8eac6-93b8-4d32-8bd1-3d3050150536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:27.948035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8eac6-93b8-4d32-8bd1-3d3050150536 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:27.948035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8eac6-93b8-4d32-8bd1-3d3050150536 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:27.948035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8eac6-93b8-4d32-8bd1-3d3050150536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:27.989863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:28.004725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8eac6-93b8-4d32-8bd1-3d3050150536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:28.006181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8eac6-93b8-4d32-8bd1-3d3050150536 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:28.015604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1360/2688] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:28.489809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cdc39-2e6a-454d-8916-a7bb7e9c9f5f service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:28.553211 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cdc39-2e6a-454d-8916-a7bb7e9c9f5f service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:28.557768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:28.558629 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:28.558912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:28.559192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] PATH_INFO: `/v3/users/ec52576ff58343d9a79727e85bcda4ba` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:28.560403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec52576ff58343d9a79727e85bcda4ba)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:28.562339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:28.763748 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec52576ff58343d9a79727e85bcda4ba'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:28.764483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec52576ff58343d9a79727e85bcda4ba'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:28.772245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec52576ff58343d9a79727e85bcda4ba'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:28.784221 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec52576ff58343d9a79727e85bcda4ba'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:28.868952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec52576ff58343d9a79727e85bcda4ba'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:28.875700 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1329/2689] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:28 2022] DELETE /identity/v3/users/ec52576ff58343d9a79727e85bcda4ba => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:28.885675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8308d-8eeb-4547-abfb-73952df684ba None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:28.885963 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8308d-8eeb-4547-abfb-73952df684ba None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:28.886238 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8308d-8eeb-4547-abfb-73952df684ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:28.904818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-b5f8308d-8eeb-4547-abfb-73952df684ba None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:28.905630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b5f8308d-8eeb-4547-abfb-73952df684ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:28.965417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1361/2690] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:28.976243 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:28.977697 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:29.034324 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8c51c-bbff-442a-8f2a-4e7d0a511e7b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:29.038760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6869aca-a2a1-4c61-84b1-d5e20babf080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:29.039412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6869aca-a2a1-4c61-84b1-d5e20babf080 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:29.039730 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6869aca-a2a1-4c61-84b1-d5e20babf080 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:29.040010 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6869aca-a2a1-4c61-84b1-d5e20babf080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:29.049216 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6869aca-a2a1-4c61-84b1-d5e20babf080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:29.051377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6869aca-a2a1-4c61-84b1-d5e20babf080 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:29.061153 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1330/2691] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:29.591749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8308d-8eeb-4547-abfb-73952df684ba None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:29.593278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b5f8308d-8eeb-4547-abfb-73952df684ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:29.605699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8308d-8eeb-4547-abfb-73952df684ba None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:29.610330 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:29.611188 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:29.611472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:29.612060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] PATH_INFO: `/v3/projects/cf10412d9454423c805ff1e827c8e720` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:29.613243 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf10412d9454423c805ff1e827c8e720)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:29.615711 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:29.727286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf10412d9454423c805ff1e827c8e720', 'request_id': 'req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:29.733406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf10412d9454423c805ff1e827c8e720', 'request_id': 'req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:29.823257 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf10412d9454423c805ff1e827c8e720', 'request_id': 'req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:29.835332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] The token cache is being invalidate because project cf10412d9454423c805ff1e827c8e720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:29.835629 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:29.836290 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:29.837868 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1362/2692] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:29 2022] DELETE /identity/v3/projects/cf10412d9454423c805ff1e827c8e720 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:29.842052 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6869aca-a2a1-4c61-84b1-d5e20babf080 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:29.851942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6869aca-a2a1-4c61-84b1-d5e20babf080 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:29.865939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:29.909742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:29.911065 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:29.911345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:29.911625 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] PATH_INFO: `/v3/users/2f20cb8c4f6d487fbd54383b3194e387` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:29.912915 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f20cb8c4f6d487fbd54383b3194e387)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:29.914911 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:30.106726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f20cb8c4f6d487fbd54383b3194e387'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.107396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f20cb8c4f6d487fbd54383b3194e387'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.115075 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f20cb8c4f6d487fbd54383b3194e387'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.128357 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f20cb8c4f6d487fbd54383b3194e387'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.194948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f20cb8c4f6d487fbd54383b3194e387'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.202715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1331/2693] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:29 2022] DELETE /identity/v3/users/2f20cb8c4f6d487fbd54383b3194e387 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:30.662138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:30.663533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:30.681040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87738ab1-5ce4-4e96-9e4a-59270d6cc6e3 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:30.696045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:30.696045 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:30.757406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:30.758278 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.758567 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.759029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] PATH_INFO: `/v3/projects/13d4a964acc34f95be809a19f3386cd0` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.760198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d4a964acc34f95be809a19f3386cd0)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:30.762460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:30.767281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354983d-7620-420e-9be0-1657fb9cae6d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:30.773490 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:30.773673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:30.774412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.774695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.774971 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] PATH_INFO: `/v3/users/f8c8686de96e4247a8c7eaded489b54f` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.776184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c8686de96e4247a8c7eaded489b54f)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:30.778228 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:30.863704 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d4a964acc34f95be809a19f3386cd0', 'request_id': 'req-072f9e8e-8495-4ab9-a2af-641309151eda'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.869664 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d4a964acc34f95be809a19f3386cd0', 'request_id': 'req-072f9e8e-8495-4ab9-a2af-641309151eda'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.949161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d4a964acc34f95be809a19f3386cd0', 'request_id': 'req-072f9e8e-8495-4ab9-a2af-641309151eda'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.958277 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:30.961727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] The token cache is being invalidate because project 13d4a964acc34f95be809a19f3386cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:30.962021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.962657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-072f9e8e-8495-4ab9-a2af-641309151eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.964164 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c8686de96e4247a8c7eaded489b54f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.964322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1363/2694] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:30 2022] DELETE /identity/v3/projects/13d4a964acc34f95be809a19f3386cd0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:30.969073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c8686de96e4247a8c7eaded489b54f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.969955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da642b1-8ef6-4c08-99bb-33101e4baf09 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:30.970254 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da642b1-8ef6-4c08-99bb-33101e4baf09 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:30.970812 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da642b1-8ef6-4c08-99bb-33101e4baf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:30.977130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c8686de96e4247a8c7eaded489b54f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.989073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c8686de96e4247a8c7eaded489b54f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:30.990494 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-4da642b1-8ef6-4c08-99bb-33101e4baf09 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:30.991710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-4da642b1-8ef6-4c08-99bb-33101e4baf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.051443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1364/2695] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:31.052451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-7f3e2344-2bf2-4ddb-8f84-d86e01de34a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c8686de96e4247a8c7eaded489b54f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:31.060130 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1332/2696] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:30 2022] DELETE /identity/v3/users/f8c8686de96e4247a8c7eaded489b54f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:31.061392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba04834-1522-4fd7-ad6c-26e02679a346 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.061392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba04834-1522-4fd7-ad6c-26e02679a346 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.061392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba04834-1522-4fd7-ad6c-26e02679a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.064580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b467d-3b97-47dc-b6b2-6dba4fd59052 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.064877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b467d-3b97-47dc-b6b2-6dba4fd59052 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.065165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b467d-3b97-47dc-b6b2-6dba4fd59052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.080983 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-0ba04834-1522-4fd7-ad6c-26e02679a346 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:31.083064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0ba04834-1522-4fd7-ad6c-26e02679a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.083695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-8b1b467d-3b97-47dc-b6b2-6dba4fd59052 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:31.084925 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8b1b467d-3b97-47dc-b6b2-6dba4fd59052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.145258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1365/2697] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:31.145800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1333/2698] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:31.149523 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba04834-1522-4fd7-ad6c-26e02679a346 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.155828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b467d-3b97-47dc-b6b2-6dba4fd59052 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.157232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-8b1b467d-3b97-47dc-b6b2-6dba4fd59052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.158885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba04834-1522-4fd7-ad6c-26e02679a346 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.164744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942194ea-4175-41a5-a12d-8b5ba9389f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.170442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942194ea-4175-41a5-a12d-8b5ba9389f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.170442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942194ea-4175-41a5-a12d-8b5ba9389f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.170442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942194ea-4175-41a5-a12d-8b5ba9389f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.170442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942194ea-4175-41a5-a12d-8b5ba9389f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:31.170442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942194ea-4175-41a5-a12d-8b5ba9389f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.170442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942194ea-4175-41a5-a12d-8b5ba9389f17 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.185003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1366/2699] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:31.185683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942194ea-4175-41a5-a12d-8b5ba9389f17 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.200750 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942194ea-4175-41a5-a12d-8b5ba9389f17 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.205535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111dd21-612b-4dcd-bc16-68818397d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.206221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111dd21-612b-4dcd-bc16-68818397d8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.206512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111dd21-612b-4dcd-bc16-68818397d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.206795 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111dd21-612b-4dcd-bc16-68818397d8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.208595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111dd21-612b-4dcd-bc16-68818397d8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.210601 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111dd21-612b-4dcd-bc16-68818397d8a3 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.231264 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b467d-3b97-47dc-b6b2-6dba4fd59052 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.235000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585438d-b9b3-4eba-a4c9-1349d346f863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.236071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585438d-b9b3-4eba-a4c9-1349d346f863 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.236071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585438d-b9b3-4eba-a4c9-1349d346f863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.236335 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585438d-b9b3-4eba-a4c9-1349d346f863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.246205 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585438d-b9b3-4eba-a4c9-1349d346f863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.247656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585438d-b9b3-4eba-a4c9-1349d346f863 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.257968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1334/2700] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:31.258759 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585438d-b9b3-4eba-a4c9-1349d346f863 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.260127 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6585438d-b9b3-4eba-a4c9-1349d346f863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.274329 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585438d-b9b3-4eba-a4c9-1349d346f863 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.279568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.280484 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.281996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.281996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] PATH_INFO: `/v3/users/6b8d2ada97d04fbd9224df7386d3ada8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.282252 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8d2ada97d04fbd9224df7386d3ada8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.284149 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.301141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1367/2701] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:31 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:31.306020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111dd21-612b-4dcd-bc16-68818397d8a3 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.311266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:31.370993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111dd21-612b-4dcd-bc16-68818397d8a3 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.375674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f0a61-e55e-413e-a673-e260e6beae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.376363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f0a61-e55e-413e-a673-e260e6beae0f admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.376676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f0a61-e55e-413e-a673-e260e6beae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.376929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f0a61-e55e-413e-a673-e260e6beae0f admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.377615 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f0a61-e55e-413e-a673-e260e6beae0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.380060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f0a61-e55e-413e-a673-e260e6beae0f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.414378 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8d2ada97d04fbd9224df7386d3ada8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:31.415059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8d2ada97d04fbd9224df7386d3ada8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:31.421562 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:31.424432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8d2ada97d04fbd9224df7386d3ada8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:31.437640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8d2ada97d04fbd9224df7386d3ada8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:31.455676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1368/2702] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:31 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:31.457832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f0a61-e55e-413e-a673-e260e6beae0f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.475079 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f0a61-e55e-413e-a673-e260e6beae0f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.480710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04dd4e-cbaf-424a-beeb-2e887c8854bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.481417 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04dd4e-cbaf-424a-beeb-2e887c8854bf admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.481707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04dd4e-cbaf-424a-beeb-2e887c8854bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.481988 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04dd4e-cbaf-424a-beeb-2e887c8854bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.482749 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04dd4e-cbaf-424a-beeb-2e887c8854bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.484396 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04dd4e-cbaf-424a-beeb-2e887c8854bf admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.492189 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-c2da2705-0ddd-4a3f-adcd-40446515701a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8d2ada97d04fbd9224df7386d3ada8'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:31.496452 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1369/2703] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:31.501323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04dd4e-cbaf-424a-beeb-2e887c8854bf admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.502638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1335/2704] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:31 2022] DELETE /identity/v3/users/6b8d2ada97d04fbd9224df7386d3ada8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:31.506334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-1f04dd4e-cbaf-424a-beeb-2e887c8854bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.508325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d905ee-2cdb-4969-bd49-3eabe86a6977 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.509141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d905ee-2cdb-4969-bd49-3eabe86a6977 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.509141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d905ee-2cdb-4969-bd49-3eabe86a6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.517521 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04dd4e-cbaf-424a-beeb-2e887c8854bf admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.527558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-32d905ee-2cdb-4969-bd49-3eabe86a6977 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:31.528815 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-32d905ee-2cdb-4969-bd49-3eabe86a6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.585342 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1a58e-d51a-49f8-a123-22b7d1c49520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.586110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1a58e-d51a-49f8-a123-22b7d1c49520 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.588252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1a58e-d51a-49f8-a123-22b7d1c49520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.588252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1a58e-d51a-49f8-a123-22b7d1c49520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.588252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1a58e-d51a-49f8-a123-22b7d1c49520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.589371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1a58e-d51a-49f8-a123-22b7d1c49520 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.599912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1370/2705] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:31.603966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1a58e-d51a-49f8-a123-22b7d1c49520 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.606797 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1336/2706] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:31.614582 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1a58e-d51a-49f8-a123-22b7d1c49520 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.616230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d905ee-2cdb-4969-bd49-3eabe86a6977 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.617635 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-32d905ee-2cdb-4969-bd49-3eabe86a6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.619401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c983a-984b-401f-be9e-1d78de9f03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.620323 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c983a-984b-401f-be9e-1d78de9f03d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.620609 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c983a-984b-401f-be9e-1d78de9f03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.620889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c983a-984b-401f-be9e-1d78de9f03d5 admin admin] PATH_INFO: `/v3/projects/8accbe2ccd0d415fa3f31e3b0f6298db/users/b78d8e7ea1c24cc5ba664b410e7ed39a/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.636772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c983a-984b-401f-be9e-1d78de9f03d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8accbe2ccd0d415fa3f31e3b0f6298db, user_id=b78d8e7ea1c24cc5ba664b410e7ed39a, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.639554 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c983a-984b-401f-be9e-1d78de9f03d5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.674380 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d905ee-2cdb-4969-bd49-3eabe86a6977 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.680384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849781-4808-4e50-9a10-cd3b5555a261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.681004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849781-4808-4e50-9a10-cd3b5555a261 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.681349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849781-4808-4e50-9a10-cd3b5555a261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.682181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849781-4808-4e50-9a10-cd3b5555a261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.694021 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac849781-4808-4e50-9a10-cd3b5555a261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.697277 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac849781-4808-4e50-9a10-cd3b5555a261 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.705531 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1337/2707] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:31.706379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849781-4808-4e50-9a10-cd3b5555a261 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.707923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ac849781-4808-4e50-9a10-cd3b5555a261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.726230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1371/2708] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:31 2022] PUT /identity/v3/projects/8accbe2ccd0d415fa3f31e3b0f6298db/users/b78d8e7ea1c24cc5ba664b410e7ed39a/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:31.726724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849781-4808-4e50-9a10-cd3b5555a261 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.726845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b635dd7-fb5d-4573-b564-ba8cdf4c454a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.726845 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b635dd7-fb5d-4573-b564-ba8cdf4c454a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.727019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b635dd7-fb5d-4573-b564-ba8cdf4c454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.748017 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-0b635dd7-fb5d-4573-b564-ba8cdf4c454a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:31.749284 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0b635dd7-fb5d-4573-b564-ba8cdf4c454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:31.793387 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.794719 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.795004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.795713 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] PATH_INFO: `/v3/projects/f31f732170f54620aaec290a37a6d829` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.797240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31f732170f54620aaec290a37a6d829)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.800166 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.801555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:31.814010 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1372/2709] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:31.821350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:31.824336 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b635dd7-fb5d-4573-b564-ba8cdf4c454a None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:31.877777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b635dd7-fb5d-4573-b564-ba8cdf4c454a None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:31.881756 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aba267-403e-400a-9af6-6876c322a0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:31.882390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba267-403e-400a-9af6-6876c322a0be service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:31.882676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba267-403e-400a-9af6-6876c322a0be service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:31.882949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba267-403e-400a-9af6-6876c322a0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:31.891955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aba267-403e-400a-9af6-6876c322a0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:31.893423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aba267-403e-400a-9af6-6876c322a0be service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:31.904061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1373/2710] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:31.922698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31f732170f54620aaec290a37a6d829', 'request_id': 'req-59d8f1f2-0634-43b0-ab2c-2379985754a2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.029690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31f732170f54620aaec290a37a6d829', 'request_id': 'req-59d8f1f2-0634-43b0-ab2c-2379985754a2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.040749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31f732170f54620aaec290a37a6d829', 'request_id': 'req-59d8f1f2-0634-43b0-ab2c-2379985754a2'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.049678 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] The token cache is being invalidate because project f31f732170f54620aaec290a37a6d829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:32.049973 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.051353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-59d8f1f2-0634-43b0-ab2c-2379985754a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.053603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1338/2711] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:31 2022] DELETE /identity/v3/projects/f31f732170f54620aaec290a37a6d829 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:32.059348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abe9c-dbfb-45ef-a193-5829f01ee0d8 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.063884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abe9c-dbfb-45ef-a193-5829f01ee0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.063884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abe9c-dbfb-45ef-a193-5829f01ee0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.081042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-f85abe9c-dbfb-45ef-a193-5829f01ee0d8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:32.082657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f85abe9c-dbfb-45ef-a193-5829f01ee0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:32.140222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1374/2712] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:32.148470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20192a-7dc0-4a32-8f92-0d2efc04e275 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.153859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20192a-7dc0-4a32-8f92-0d2efc04e275 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.153859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20192a-7dc0-4a32-8f92-0d2efc04e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.168012 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-fb20192a-7dc0-4a32-8f92-0d2efc04e275 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:32.169241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-fb20192a-7dc0-4a32-8f92-0d2efc04e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:32.180717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abe9c-dbfb-45ef-a193-5829f01ee0d8 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.181751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1339/2713] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:32.190189 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f85abe9c-dbfb-45ef-a193-5829f01ee0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:32.190471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20192a-7dc0-4a32-8f92-0d2efc04e275 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.197969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20192a-7dc0-4a32-8f92-0d2efc04e275 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:32.204418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5af984-2b88-498f-bfbb-677090a5cf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:32.205048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abe9c-dbfb-45ef-a193-5829f01ee0d8 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:32.205623 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5af984-2b88-498f-bfbb-677090a5cf8e admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.205922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5af984-2b88-498f-bfbb-677090a5cf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.206296 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5af984-2b88-498f-bfbb-677090a5cf8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.208187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5af984-2b88-498f-bfbb-677090a5cf8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:32.208187 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5af984-2b88-498f-bfbb-677090a5cf8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:32.210162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5af984-2b88-498f-bfbb-677090a5cf8e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:32.212145 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:32.213621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.214055 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.214499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] PATH_INFO: `/v3/projects/02cdf96cb4fd42519f35d0fe325ce2c8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.216269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02cdf96cb4fd42519f35d0fe325ce2c8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:32.224451 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:32.240485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1340/2714] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:56:32.246596 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5af984-2b88-498f-bfbb-677090a5cf8e admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.251792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5af984-2b88-498f-bfbb-677090a5cf8e admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:32.256790 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a0e17-85b1-440d-9247-7bc2e5e5f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:32.259699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a0e17-85b1-440d-9247-7bc2e5e5f51c admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.259699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a0e17-85b1-440d-9247-7bc2e5e5f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.259699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a0e17-85b1-440d-9247-7bc2e5e5f51c admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.259699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a0e17-85b1-440d-9247-7bc2e5e5f51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:32.260757 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a0e17-85b1-440d-9247-7bc2e5e5f51c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:32.327269 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02cdf96cb4fd42519f35d0fe325ce2c8', 'request_id': 'req-893373a3-196a-4976-b567-80a066840fb6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.345168 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02cdf96cb4fd42519f35d0fe325ce2c8', 'request_id': 'req-893373a3-196a-4976-b567-80a066840fb6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.374161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1341/2715] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:32 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:32.375455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a0e17-85b1-440d-9247-7bc2e5e5f51c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.428818 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02cdf96cb4fd42519f35d0fe325ce2c8', 'request_id': 'req-893373a3-196a-4976-b567-80a066840fb6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.438779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a0e17-85b1-440d-9247-7bc2e5e5f51c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:32.441117 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] The token cache is being invalidate because project 02cdf96cb4fd42519f35d0fe325ce2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:32.441454 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.442215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:32.443876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1375/2716] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:32 2022] DELETE /identity/v3/projects/02cdf96cb4fd42519f35d0fe325ce2c8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:56:32.444023 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432b278-db59-4b0a-8041-2521642e8ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:32.444829 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432b278-db59-4b0a-8041-2521642e8ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.445118 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432b278-db59-4b0a-8041-2521642e8ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.445396 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432b278-db59-4b0a-8041-2521642e8ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.446077 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432b278-db59-4b0a-8041-2521642e8ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:32.448074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432b278-db59-4b0a-8041-2521642e8ea6 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:32.528698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1342/2717] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:32 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:32.533852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.536165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:32.573387 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:32.650657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893373a3-196a-4976-b567-80a066840fb6 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:32.656584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa0039-582e-4f9c-9f03-3beedcb86509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:32.657280 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa0039-582e-4f9c-9f03-3beedcb86509 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.657816 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa0039-582e-4f9c-9f03-3beedcb86509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.658090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa0039-582e-4f9c-9f03-3beedcb86509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.658984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa0039-582e-4f9c-9f03-3beedcb86509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:32.660899 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa0039-582e-4f9c-9f03-3beedcb86509 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:32.676612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1376/2718] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:32.677970 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432b278-db59-4b0a-8041-2521642e8ea6 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.688267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432b278-db59-4b0a-8041-2521642e8ea6 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:32.693703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720591e7-be1f-4cd8-ab20-fc5bc9d8e206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:32.694361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720591e7-be1f-4cd8-ab20-fc5bc9d8e206 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.694643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720591e7-be1f-4cd8-ab20-fc5bc9d8e206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.694918 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720591e7-be1f-4cd8-ab20-fc5bc9d8e206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.695638 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720591e7-be1f-4cd8-ab20-fc5bc9d8e206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:32.697279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720591e7-be1f-4cd8-ab20-fc5bc9d8e206 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:32.707116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1343/2719] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:32.712141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa0039-582e-4f9c-9f03-3beedcb86509 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.722003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa0039-582e-4f9c-9f03-3beedcb86509 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:32.726831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6820ccf-009a-4e50-a903-c728cd067590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:32.727832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6820ccf-009a-4e50-a903-c728cd067590 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.728115 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6820ccf-009a-4e50-a903-c728cd067590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.728426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6820ccf-009a-4e50-a903-c728cd067590 admin admin] PATH_INFO: `/v3/projects/96967c2d1cf04127ad38fd6f79427479/users/3b424f2f8dfa401a895bcb294aca072e/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.743759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6820ccf-009a-4e50-a903-c728cd067590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96967c2d1cf04127ad38fd6f79427479, user_id=3b424f2f8dfa401a895bcb294aca072e, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:32.746519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6820ccf-009a-4e50-a903-c728cd067590 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:32.824866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1377/2720] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:32 2022] PUT /identity/v3/projects/96967c2d1cf04127ad38fd6f79427479/users/3b424f2f8dfa401a895bcb294aca072e/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:32.836226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76030fb7-68ac-444e-97dc-466d8b821f7f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:32.836587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76030fb7-68ac-444e-97dc-466d8b821f7f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:32.836869 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76030fb7-68ac-444e-97dc-466d8b821f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:32.864721 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-76030fb7-68ac-444e-97dc-466d8b821f7f None None] MFA Rules not processed for user `3b424f2f8dfa401a895bcb294aca072e`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:32.865947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-76030fb7-68ac-444e-97dc-466d8b821f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:32.897110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:32.930432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1344/2721] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:32.943075 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6820ccf-009a-4e50-a903-c728cd067590 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:32.944878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e6820ccf-009a-4e50-a903-c728cd067590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:33.022876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6820ccf-009a-4e50-a903-c728cd067590 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:33.028531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed78c8-4a6b-4b10-baca-4ca2a10488e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:33.029184 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed78c8-4a6b-4b10-baca-4ca2a10488e3 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.029472 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed78c8-4a6b-4b10-baca-4ca2a10488e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.029748 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed78c8-4a6b-4b10-baca-4ca2a10488e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.039951 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed78c8-4a6b-4b10-baca-4ca2a10488e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:33.041650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed78c8-4a6b-4b10-baca-4ca2a10488e3 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:33.051689 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1378/2722] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:33.253657 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf8980-599e-47db-a89d-eb975659f711 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.254349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf8980-599e-47db-a89d-eb975659f711 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.254349 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf8980-599e-47db-a89d-eb975659f711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.283935 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-7adf8980-599e-47db-a89d-eb975659f711 None None] MFA Rules not processed for user `b78d8e7ea1c24cc5ba664b410e7ed39a`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:33.285810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-7adf8980-599e-47db-a89d-eb975659f711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:33.358445 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1345/2723] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:33.368499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed78c8-4a6b-4b10-baca-4ca2a10488e3 service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:33.370068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-78ed78c8-4a6b-4b10-baca-4ca2a10488e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:33.431118 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed78c8-4a6b-4b10-baca-4ca2a10488e3 service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:33.437747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f8233-2a97-490d-a0a0-c6f9d722dd54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:33.437747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f8233-2a97-490d-a0a0-c6f9d722dd54 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:33.437747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f8233-2a97-490d-a0a0-c6f9d722dd54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:33.437747 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f8233-2a97-490d-a0a0-c6f9d722dd54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:33.446012 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f8233-2a97-490d-a0a0-c6f9d722dd54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:33.447468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f8233-2a97-490d-a0a0-c6f9d722dd54 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:33.457688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1379/2724] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:35.178196 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff6995-4ef3-422c-9e9b-af7dcb4c5ba2 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:35.178818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff6995-4ef3-422c-9e9b-af7dcb4c5ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:35.178923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff6995-4ef3-422c-9e9b-af7dcb4c5ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:35.197780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1bff6995-4ef3-422c-9e9b-af7dcb4c5ba2 None None] MFA Rules not processed for user `b78d8e7ea1c24cc5ba664b410e7ed39a`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:35.199059 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1bff6995-4ef3-422c-9e9b-af7dcb4c5ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:35.206015 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1346/2725] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:36.187520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f8233-2a97-490d-a0a0-c6f9d722dd54 service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:36.201287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:36.244545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f8233-2a97-490d-a0a0-c6f9d722dd54 service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:36.249301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:36.250160 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.250442 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.250712 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] PATH_INFO: `/v3/users/3b424f2f8dfa401a895bcb294aca072e` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.251993 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b424f2f8dfa401a895bcb294aca072e)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:36.253984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:36.391790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b424f2f8dfa401a895bcb294aca072e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:36.446608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b424f2f8dfa401a895bcb294aca072e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:36.447279 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b424f2f8dfa401a895bcb294aca072e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:36.448059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b424f2f8dfa401a895bcb294aca072e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:36.458002 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b424f2f8dfa401a895bcb294aca072e'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:36.477565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1380/2726] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:56:36 2022] DELETE /identity/v3/users/3b424f2f8dfa401a895bcb294aca072e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:36.481771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048664c4-9f95-44b9-80a9-61270e7d872f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.482273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048664c4-9f95-44b9-80a9-61270e7d872f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.482377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048664c4-9f95-44b9-80a9-61270e7d872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.500377 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-048664c4-9f95-44b9-80a9-61270e7d872f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:36.501581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-048664c4-9f95-44b9-80a9-61270e7d872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:36.560724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1347/2727] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:36.570437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:36.571865 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:36.630034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5abf5-28c0-4287-9879-6491e8997b0c admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:36.633709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a122e6-ae1e-4893-be6d-06480bae7e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:36.634354 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a122e6-ae1e-4893-be6d-06480bae7e88 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:36.634640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a122e6-ae1e-4893-be6d-06480bae7e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:36.634916 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a122e6-ae1e-4893-be6d-06480bae7e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:36.643877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a122e6-ae1e-4893-be6d-06480bae7e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:36.645294 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a122e6-ae1e-4893-be6d-06480bae7e88 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:36.655392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1381/2728] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:37.117233 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048664c4-9f95-44b9-80a9-61270e7d872f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.118653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-048664c4-9f95-44b9-80a9-61270e7d872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:37.131390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048664c4-9f95-44b9-80a9-61270e7d872f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.135923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.137605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.137605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.137605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] PATH_INFO: `/v3/projects/96967c2d1cf04127ad38fd6f79427479` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.138624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96967c2d1cf04127ad38fd6f79427479)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.140569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.234915 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a122e6-ae1e-4893-be6d-06480bae7e88 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.236529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-52a122e6-ae1e-4893-be6d-06480bae7e88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:37.249695 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a122e6-ae1e-4893-be6d-06480bae7e88 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.250794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96967c2d1cf04127ad38fd6f79427479', 'request_id': 'req-cd243265-6ba9-4812-ae80-7f315ca5aec3'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:37.252646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.290920 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:37.299861 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda3427-e71f-41aa-866c-bbce9351d5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.300557 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3427-e71f-41aa-866c-bbce9351d5db service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.300846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3427-e71f-41aa-866c-bbce9351d5db service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.301124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3427-e71f-41aa-866c-bbce9351d5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.303892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ddda3427-e71f-41aa-866c-bbce9351d5db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:37.314006 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda3427-e71f-41aa-866c-bbce9351d5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.316562 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda3427-e71f-41aa-866c-bbce9351d5db service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.327064 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96967c2d1cf04127ad38fd6f79427479', 'request_id': 'req-cd243265-6ba9-4812-ae80-7f315ca5aec3'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:37.328542 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1382/2729] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:56:37.335497 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96967c2d1cf04127ad38fd6f79427479', 'request_id': 'req-cd243265-6ba9-4812-ae80-7f315ca5aec3'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:37.346994 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] The token cache is being invalidate because project 96967c2d1cf04127ad38fd6f79427479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:56:37.353569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:37.353569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-cd243265-6ba9-4812-ae80-7f315ca5aec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:56:37.353569 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1348/2730] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:56:37 2022] DELETE /identity/v3/projects/96967c2d1cf04127ad38fd6f79427479 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:37.355901 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1f59a-6eb3-4cfe-b83f-bf17de3d5eb9 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.356343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1f59a-6eb3-4cfe-b83f-bf17de3d5eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.356658 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1f59a-6eb3-4cfe-b83f-bf17de3d5eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.375641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7ce1f59a-6eb3-4cfe-b83f-bf17de3d5eb9 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:37.377021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7ce1f59a-6eb3-4cfe-b83f-bf17de3d5eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:37.438375 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1383/2731] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:37.446098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011aff7-5877-425d-b8de-af4262240671 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.446410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011aff7-5877-425d-b8de-af4262240671 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.448427 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011aff7-5877-425d-b8de-af4262240671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.465156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b011aff7-5877-425d-b8de-af4262240671 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:37.466413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b011aff7-5877-425d-b8de-af4262240671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:37.475386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1349/2732] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:56:37.479498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1f59a-6eb3-4cfe-b83f-bf17de3d5eb9 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.488897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1f59a-6eb3-4cfe-b83f-bf17de3d5eb9 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.494227 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a7012-078b-449d-8cad-623d21b8b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.494877 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a7012-078b-449d-8cad-623d21b8b538 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.495180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a7012-078b-449d-8cad-623d21b8b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.495440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a7012-078b-449d-8cad-623d21b8b538 admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.496154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a7012-078b-449d-8cad-623d21b8b538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:56:37.496507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a7012-078b-449d-8cad-623d21b8b538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.498515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a7012-078b-449d-8cad-623d21b8b538 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.510829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1384/2733] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:56:37.514992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011aff7-5877-425d-b8de-af4262240671 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.524161 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011aff7-5877-425d-b8de-af4262240671 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.528856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7d6cf-6a44-4e5b-8c19-0797deb1d528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.529504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7d6cf-6a44-4e5b-8c19-0797deb1d528 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.529787 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7d6cf-6a44-4e5b-8c19-0797deb1d528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.530063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7d6cf-6a44-4e5b-8c19-0797deb1d528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.530743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7d6cf-6a44-4e5b-8c19-0797deb1d528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.532668 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7d6cf-6a44-4e5b-8c19-0797deb1d528 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.591391 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1350/2734] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:37 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:37.595657 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a7012-078b-449d-8cad-623d21b8b538 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.607128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a7012-078b-449d-8cad-623d21b8b538 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.669127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde7066-86c6-4bc7-875b-59235cd92f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.669808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde7066-86c6-4bc7-875b-59235cd92f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.670101 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde7066-86c6-4bc7-875b-59235cd92f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.670381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde7066-86c6-4bc7-875b-59235cd92f09 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.671074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde7066-86c6-4bc7-875b-59235cd92f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.673145 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde7066-86c6-4bc7-875b-59235cd92f09 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.763637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1385/2735] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:37 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:37.765271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7d6cf-6a44-4e5b-8c19-0797deb1d528 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.776651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7d6cf-6a44-4e5b-8c19-0797deb1d528 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.782043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ca1b1-bbc3-4b5e-9894-cbeb5ac48225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.782856 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ca1b1-bbc3-4b5e-9894-cbeb5ac48225 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.783301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ca1b1-bbc3-4b5e-9894-cbeb5ac48225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.783572 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ca1b1-bbc3-4b5e-9894-cbeb5ac48225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.784621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ca1b1-bbc3-4b5e-9894-cbeb5ac48225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.786409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ca1b1-bbc3-4b5e-9894-cbeb5ac48225 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.800449 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1351/2736] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:37.805263 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde7066-86c6-4bc7-875b-59235cd92f09 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.816120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde7066-86c6-4bc7-875b-59235cd92f09 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.822361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3148fb-834c-4863-964c-268de31fb75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.823031 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3148fb-834c-4863-964c-268de31fb75d admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.823405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3148fb-834c-4863-964c-268de31fb75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.823681 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3148fb-834c-4863-964c-268de31fb75d admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.824581 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3148fb-834c-4863-964c-268de31fb75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.826201 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3148fb-834c-4863-964c-268de31fb75d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.838626 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1386/2737] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:56:37.843417 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ca1b1-bbc3-4b5e-9894-cbeb5ac48225 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:37.856526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ca1b1-bbc3-4b5e-9894-cbeb5ac48225 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:37.863791 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06b59e-1b69-4774-8fd1-010514fffddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:37.866561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06b59e-1b69-4774-8fd1-010514fffddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.866561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06b59e-1b69-4774-8fd1-010514fffddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.866561 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06b59e-1b69-4774-8fd1-010514fffddb admin admin] PATH_INFO: `/v3/projects/af421641f43844e3b8502796d57103f9/users/2a4a9e0833c74fe6889c34d4ad12375f/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:37.884266 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06b59e-1b69-4774-8fd1-010514fffddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=af421641f43844e3b8502796d57103f9, user_id=2a4a9e0833c74fe6889c34d4ad12375f, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:37.887418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06b59e-1b69-4774-8fd1-010514fffddb admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:37.962714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1352/2738] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:37 2022] PUT /identity/v3/projects/af421641f43844e3b8502796d57103f9/users/2a4a9e0833c74fe6889c34d4ad12375f/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:37.973325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893677c0-b017-482f-af5a-976453dc31a2 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:37.973617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893677c0-b017-482f-af5a-976453dc31a2 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:37.973896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893677c0-b017-482f-af5a-976453dc31a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.038414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-893677c0-b017-482f-af5a-976453dc31a2 None None] MFA Rules not processed for user `2a4a9e0833c74fe6889c34d4ad12375f`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:38.039656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-893677c0-b017-482f-af5a-976453dc31a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:38.110579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:38.141866 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1387/2739] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:38.149171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06b59e-1b69-4774-8fd1-010514fffddb admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.252919 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06b59e-1b69-4774-8fd1-010514fffddb admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.258894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95172395-8a21-4d9e-b879-c012cc01a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.259563 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95172395-8a21-4d9e-b879-c012cc01a1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.259847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95172395-8a21-4d9e-b879-c012cc01a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.260156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95172395-8a21-4d9e-b879-c012cc01a1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.260890 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95172395-8a21-4d9e-b879-c012cc01a1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.262800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95172395-8a21-4d9e-b879-c012cc01a1f6 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.340828 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1353/2740] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:56:38 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:56:38.345425 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893677c0-b017-482f-af5a-976453dc31a2 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.356128 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893677c0-b017-482f-af5a-976453dc31a2 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.415980 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924beb-3246-4e3d-bee0-92431e3291de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.416719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924beb-3246-4e3d-bee0-92431e3291de admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.417005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924beb-3246-4e3d-bee0-92431e3291de admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.417279 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924beb-3246-4e3d-bee0-92431e3291de admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.417984 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0924beb-3246-4e3d-bee0-92431e3291de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.419930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0924beb-3246-4e3d-bee0-92431e3291de admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.498165 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1388/2741] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:56:38 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:56:38.502205 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95172395-8a21-4d9e-b879-c012cc01a1f6 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.513148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95172395-8a21-4d9e-b879-c012cc01a1f6 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.517755 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5635ce5-885b-4ada-8ba4-7f888d1a6971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.518408 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635ce5-885b-4ada-8ba4-7f888d1a6971 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.521825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635ce5-885b-4ada-8ba4-7f888d1a6971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.521825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635ce5-885b-4ada-8ba4-7f888d1a6971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.521825 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5635ce5-885b-4ada-8ba4-7f888d1a6971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.525863 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5635ce5-885b-4ada-8ba4-7f888d1a6971 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.537081 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1354/2742] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:38.541614 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924beb-3246-4e3d-bee0-92431e3291de admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.551913 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924beb-3246-4e3d-bee0-92431e3291de admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.557507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631526a-56e3-46da-a2de-1163c70e6970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.558338 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631526a-56e3-46da-a2de-1163c70e6970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.558623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631526a-56e3-46da-a2de-1163c70e6970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.558894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631526a-56e3-46da-a2de-1163c70e6970 admin admin] PATH_INFO: `/v3/projects/4fb47f2fe504407caecfa3306b478927/users/13cd1662d61143ff87a8b0dbb26cbf9a/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.575371 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631526a-56e3-46da-a2de-1163c70e6970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb47f2fe504407caecfa3306b478927, user_id=13cd1662d61143ff87a8b0dbb26cbf9a, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.578654 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631526a-56e3-46da-a2de-1163c70e6970 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.661836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1389/2743] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:38 2022] PUT /identity/v3/projects/4fb47f2fe504407caecfa3306b478927/users/13cd1662d61143ff87a8b0dbb26cbf9a/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:38.663630 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5635ce5-885b-4ada-8ba4-7f888d1a6971 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.674268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5635ce5-885b-4ada-8ba4-7f888d1a6971 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.722507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:38.734570 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223215-1eeb-44a7-aec9-c59418d9dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.735232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223215-1eeb-44a7-aec9-c59418d9dacd admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.735551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223215-1eeb-44a7-aec9-c59418d9dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.735831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223215-1eeb-44a7-aec9-c59418d9dacd admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.736574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223215-1eeb-44a7-aec9-c59418d9dacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.738162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223215-1eeb-44a7-aec9-c59418d9dacd admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.748633 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1355/2744] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:56:38.752919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631526a-56e3-46da-a2de-1163c70e6970 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.763871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631526a-56e3-46da-a2de-1163c70e6970 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.768551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fcdd5-c3c0-4fc0-ab87-84392ca17b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.769444 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fcdd5-c3c0-4fc0-ab87-84392ca17b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.769727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fcdd5-c3c0-4fc0-ab87-84392ca17b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.770001 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fcdd5-c3c0-4fc0-ab87-84392ca17b57 admin admin] PATH_INFO: `/v3/projects/4fb47f2fe504407caecfa3306b478927/users/13cd1662d61143ff87a8b0dbb26cbf9a/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.772141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fcdd5-c3c0-4fc0-ab87-84392ca17b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb47f2fe504407caecfa3306b478927, user_id=13cd1662d61143ff87a8b0dbb26cbf9a, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.774838 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fcdd5-c3c0-4fc0-ab87-84392ca17b57 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.785084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1390/2745] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:56:38 2022] PUT /identity/v3/projects/4fb47f2fe504407caecfa3306b478927/users/13cd1662d61143ff87a8b0dbb26cbf9a/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:56:38.796125 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cd64e-0284-4fe1-b74d-113a6f6718e6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.796478 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cd64e-0284-4fe1-b74d-113a6f6718e6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.796765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cd64e-0284-4fe1-b74d-113a6f6718e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.824939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-4a6cd64e-0284-4fe1-b74d-113a6f6718e6 None None] MFA Rules not processed for user `13cd1662d61143ff87a8b0dbb26cbf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:38.826110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4a6cd64e-0284-4fe1-b74d-113a6f6718e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:38.895672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1356/2746] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:38.908598 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fcdd5-c3c0-4fc0-ab87-84392ca17b57 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:38.910438 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3b4fcdd5-c3c0-4fc0-ab87-84392ca17b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:38.970307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fcdd5-c3c0-4fc0-ab87-84392ca17b57 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:38.974678 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6a863-af98-4bec-9859-21da23a8eddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:38.975337 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a863-af98-4bec-9859-21da23a8eddd service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:38.975619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a863-af98-4bec-9859-21da23a8eddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:38.975895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a863-af98-4bec-9859-21da23a8eddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:38.986606 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6a863-af98-4bec-9859-21da23a8eddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:38.988053 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6a863-af98-4bec-9859-21da23a8eddd service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:38.998530 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1391/2747] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:39.185683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cd64e-0284-4fe1-b74d-113a6f6718e6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:39.196611 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cd64e-0284-4fe1-b74d-113a6f6718e6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:39.200510 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7b9d-18c2-498a-abba-5f4e0562bf96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:39.201386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7b9d-18c2-498a-abba-5f4e0562bf96 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:39.201680 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7b9d-18c2-498a-abba-5f4e0562bf96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:39.202318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7b9d-18c2-498a-abba-5f4e0562bf96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:39.271126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f7b9d-18c2-498a-abba-5f4e0562bf96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:39.272756 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f7b9d-18c2-498a-abba-5f4e0562bf96 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:39.283203 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1357/2748] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:39.642172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6a863-af98-4bec-9859-21da23a8eddd service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:39.642172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c6a6a863-af98-4bec-9859-21da23a8eddd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:39.701867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:39.740504 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6a863-af98-4bec-9859-21da23a8eddd service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:39.746413 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:39.747065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:39.747399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:39.747682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:39.749491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:39.762737 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:39.764380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:39.776353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1392/2749] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:49.278486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=69 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:49.817822 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=18 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:56.905102 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f124-9ce6-49d3-8917-dc234743a5bb None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:56.905682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f124-9ce6-49d3-8917-dc234743a5bb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:56.905682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f124-9ce6-49d3-8917-dc234743a5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:56.922419 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-ed01f124-9ce6-49d3-8917-dc234743a5bb None None] MFA Rules not processed for user `b78d8e7ea1c24cc5ba664b410e7ed39a`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:56:56.923615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ed01f124-9ce6-49d3-8917-dc234743a5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:56.983477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1358/2750] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:56:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:56:57.223095 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:57.224541 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:57.286071 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f024bc-3589-47aa-b17b-fbb90f8147da service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:57.290440 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6987-547e-4643-a829-34f5bff56ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:57.291133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6987-547e-4643-a829-34f5bff56ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:57.291408 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6987-547e-4643-a829-34f5bff56ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:57.291684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6987-547e-4643-a829-34f5bff56ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:57.293532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3e8f6987-547e-4643-a829-34f5bff56ec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:57.304003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6987-547e-4643-a829-34f5bff56ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:57.305632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6987-547e-4643-a829-34f5bff56ec4 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:57.313824 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1393/2751] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:56:57.780528 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01f124-9ce6-49d3-8917-dc234743a5bb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:56:57.781987 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ed01f124-9ce6-49d3-8917-dc234743a5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:57.859004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01f124-9ce6-49d3-8917-dc234743a5bb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:56:57.863959 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628fa17-1d7f-40ba-b849-1ec34c248f55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:56:57.864641 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628fa17-1d7f-40ba-b849-1ec34c248f55 service placement] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:56:57.864953 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628fa17-1d7f-40ba-b849-1ec34c248f55 service placement] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:56:57.865365 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628fa17-1d7f-40ba-b849-1ec34c248f55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:56:57.867924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b628fa17-1d7f-40ba-b849-1ec34c248f55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:56:57.879470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628fa17-1d7f-40ba-b849-1ec34c248f55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:56:57.884975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628fa17-1d7f-40ba-b849-1ec34c248f55 service placement] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:56:57.890908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1359/2752] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:56:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:07.310126 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=26 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:07.886640 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=57 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:12.722310 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6987-547e-4643-a829-34f5bff56ec4 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:12.766158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6987-547e-4643-a829-34f5bff56ec4 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:12.771996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:12.772716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:12.773005 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:12.773287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:12.775120 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:12.814684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:12.816389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:12.828357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1394/2753] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:22.823918 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=28 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:30.261005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1594b-e6bc-4a99-adde-a8a3bc221597 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:30.261526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1594b-e6bc-4a99-adde-a8a3bc221597 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:30.261526 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1594b-e6bc-4a99-adde-a8a3bc221597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:30.281552 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-26a1594b-e6bc-4a99-adde-a8a3bc221597 None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:30.282739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-26a1594b-e6bc-4a99-adde-a8a3bc221597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:30.340718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1360/2754] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:57:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:30.479640 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:30.481046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:30.549529 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d415b-e7e6-4ae7-9a1e-43b2396e2214 service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:30.554727 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c3e6b-c070-43c9-bb3c-720097a0d28c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:30.555364 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c3e6b-c070-43c9-bb3c-720097a0d28c service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:30.555650 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c3e6b-c070-43c9-bb3c-720097a0d28c service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:30.555924 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c3e6b-c070-43c9-bb3c-720097a0d28c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:30.563828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c3e6b-c070-43c9-bb3c-720097a0d28c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:30.565437 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c3e6b-c070-43c9-bb3c-720097a0d28c service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:30.573647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1395/2755] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:57:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:57:33.598126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1594b-e6bc-4a99-adde-a8a3bc221597 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:33.666353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1594b-e6bc-4a99-adde-a8a3bc221597 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:33.671724 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:33.675245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:33.675245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:33.675245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] PATH_INFO: `/v3/users/2a4a9e0833c74fe6889c34d4ad12375f` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:33.675245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4a9e0833c74fe6889c34d4ad12375f)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:33.676369 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:33.810525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4a9e0833c74fe6889c34d4ad12375f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:33.811247 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4a9e0833c74fe6889c34d4ad12375f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:33.819572 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4a9e0833c74fe6889c34d4ad12375f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:33.837620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4a9e0833c74fe6889c34d4ad12375f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:33.947345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4a9e0833c74fe6889c34d4ad12375f'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:33.954214 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1361/2756] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:57:33 2022] DELETE /identity/v3/users/2a4a9e0833c74fe6889c34d4ad12375f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:33.961003 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7face-675c-4a05-b988-8a4c38498118 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:33.962174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7face-675c-4a05-b988-8a4c38498118 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:33.962586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7face-675c-4a05-b988-8a4c38498118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:33.998764 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-faa7face-675c-4a05-b988-8a4c38498118 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:34.000094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-faa7face-675c-4a05-b988-8a4c38498118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:34.075763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1396/2757] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:57:34.086837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:34.097568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:34.122950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:34.160614 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2847b1-9beb-43b3-8036-691139ae2a72 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:34.169868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d145b-e5b1-433a-83f6-cd4f0d056569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:34.170503 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d145b-e5b1-433a-83f6-cd4f0d056569 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:34.170810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d145b-e5b1-433a-83f6-cd4f0d056569 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:34.171067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d145b-e5b1-433a-83f6-cd4f0d056569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:34.183464 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d145b-e5b1-433a-83f6-cd4f0d056569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:34.184996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d145b-e5b1-433a-83f6-cd4f0d056569 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:34.201582 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1362/2758] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:34.631153 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7face-675c-4a05-b988-8a4c38498118 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:34.634063 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-faa7face-675c-4a05-b988-8a4c38498118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:34.654985 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7face-675c-4a05-b988-8a4c38498118 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:34.675474 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:34.676325 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:34.676596 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:34.676879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] PATH_INFO: `/v3/projects/af421641f43844e3b8502796d57103f9` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:34.678955 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af421641f43844e3b8502796d57103f9)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:34.681082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:34.811510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af421641f43844e3b8502796d57103f9', 'request_id': 'req-d57daecc-ce84-47ac-928d-70f01788c3a8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:34.819132 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af421641f43844e3b8502796d57103f9', 'request_id': 'req-d57daecc-ce84-47ac-928d-70f01788c3a8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:34.873907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af421641f43844e3b8502796d57103f9', 'request_id': 'req-d57daecc-ce84-47ac-928d-70f01788c3a8'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:34.889826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] The token cache is being invalidate because project af421641f43844e3b8502796d57103f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:57:34.890151 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:34.891669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:34.897982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1397/2759] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:57:34 2022] DELETE /identity/v3/projects/af421641f43844e3b8502796d57103f9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:34.899209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d145b-e5b1-433a-83f6-cd4f0d056569 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:34.909571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d145b-e5b1-433a-83f6-cd4f0d056569 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:34.971784 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:34.972698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:34.972983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:34.973261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] PATH_INFO: `/v3/users/13cd1662d61143ff87a8b0dbb26cbf9a` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:34.974502 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cd1662d61143ff87a8b0dbb26cbf9a)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:34.976474 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:35.161340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cd1662d61143ff87a8b0dbb26cbf9a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:35.162107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cd1662d61143ff87a8b0dbb26cbf9a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:35.171037 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cd1662d61143ff87a8b0dbb26cbf9a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:35.186222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cd1662d61143ff87a8b0dbb26cbf9a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:35.304871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-273adfb9-3939-4abd-a14f-7f276cfcfb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cd1662d61143ff87a8b0dbb26cbf9a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:35.315723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1363/2760] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:57:34 2022] DELETE /identity/v3/users/13cd1662d61143ff87a8b0dbb26cbf9a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:35.762486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:35.764222 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:35.778543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:35.792803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57daecc-ce84-47ac-928d-70f01788c3a8 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:35.860949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:35.863228 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:35.863548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:35.863830 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] PATH_INFO: `/v3/projects/4fb47f2fe504407caecfa3306b478927` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:35.865846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb47f2fe504407caecfa3306b478927)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:35.867817 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:35.973793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb47f2fe504407caecfa3306b478927', 'request_id': 'req-6bdf9851-7420-4932-b51c-73de50b69a7b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:35.981660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb47f2fe504407caecfa3306b478927', 'request_id': 'req-6bdf9851-7420-4932-b51c-73de50b69a7b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:36.028716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb47f2fe504407caecfa3306b478927', 'request_id': 'req-6bdf9851-7420-4932-b51c-73de50b69a7b'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:36.042808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] The token cache is being invalidate because project 4fb47f2fe504407caecfa3306b478927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:57:36.043098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:36.043791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-6bdf9851-7420-4932-b51c-73de50b69a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:36.045468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1398/2761] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:57:35 2022] DELETE /identity/v3/projects/4fb47f2fe504407caecfa3306b478927 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:36.050761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dba755-cb2d-4559-8a58-674168fe3c4e None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:36.051279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dba755-cb2d-4559-8a58-674168fe3c4e None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:36.051368 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dba755-cb2d-4559-8a58-674168fe3c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:36.071436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-e7dba755-cb2d-4559-8a58-674168fe3c4e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:36.072842 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e7dba755-cb2d-4559-8a58-674168fe3c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:36.118488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:36.136000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1364/2762] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:57:36.145098 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca66d-f0c8-4b66-ad79-d56a2a8265c3 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:36.145385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca66d-f0c8-4b66-ad79-d56a2a8265c3 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:36.145663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca66d-f0c8-4b66-ad79-d56a2a8265c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:36.166155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-0dcca66d-f0c8-4b66-ad79-d56a2a8265c3 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:36.167398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-0dcca66d-f0c8-4b66-ad79-d56a2a8265c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:36.176197 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1399/2763] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:36.181450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dba755-cb2d-4559-8a58-674168fe3c4e None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:36.191270 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dba755-cb2d-4559-8a58-674168fe3c4e None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:36.196457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f77cf-d0f9-4903-918d-e006842a1bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:36.197139 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f77cf-d0f9-4903-918d-e006842a1bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:36.197544 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f77cf-d0f9-4903-918d-e006842a1bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:36.197827 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f77cf-d0f9-4903-918d-e006842a1bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:36.198559 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f77cf-d0f9-4903-918d-e006842a1bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:36.198863 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f77cf-d0f9-4903-918d-e006842a1bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:36.200519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f77cf-d0f9-4903-918d-e006842a1bf1 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:36.212993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1365/2764] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:36.217363 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcca66d-f0c8-4b66-ad79-d56a2a8265c3 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:36.228208 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcca66d-f0c8-4b66-ad79-d56a2a8265c3 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:36.232885 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2348eb-e777-428c-869f-8d141a9e2b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:36.233623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2348eb-e777-428c-869f-8d141a9e2b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:36.233909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2348eb-e777-428c-869f-8d141a9e2b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:36.234186 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2348eb-e777-428c-869f-8d141a9e2b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:36.234933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2348eb-e777-428c-869f-8d141a9e2b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:36.236961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2348eb-e777-428c-869f-8d141a9e2b32 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:36.441925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1400/2765] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:57:36 2022] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:57:36.446813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f77cf-d0f9-4903-918d-e006842a1bf1 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:36.457806 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f77cf-d0f9-4903-918d-e006842a1bf1 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:36.539299 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195835c-f105-48ff-acf2-3b39d5443ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:36.539992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195835c-f105-48ff-acf2-3b39d5443ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:36.540276 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195835c-f105-48ff-acf2-3b39d5443ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:36.540587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195835c-f105-48ff-acf2-3b39d5443ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:36.541295 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195835c-f105-48ff-acf2-3b39d5443ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:36.545188 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195835c-f105-48ff-acf2-3b39d5443ab4 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:36.621494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1366/2766] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:57:36 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:36.625851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2348eb-e777-428c-869f-8d141a9e2b32 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:36.640362 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2348eb-e777-428c-869f-8d141a9e2b32 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:36.647919 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c806a-db72-4395-85f6-60a8a06e6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:36.648905 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c806a-db72-4395-85f6-60a8a06e6234 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:36.649279 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c806a-db72-4395-85f6-60a8a06e6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:36.649630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c806a-db72-4395-85f6-60a8a06e6234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:36.650656 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c806a-db72-4395-85f6-60a8a06e6234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:36.652870 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c806a-db72-4395-85f6-60a8a06e6234 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:36.665603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1401/2767] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:36.676314 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195835c-f105-48ff-acf2-3b39d5443ab4 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:36.686835 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195835c-f105-48ff-acf2-3b39d5443ab4 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:36.694461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056dcc2-c81c-49b3-9cbd-48e60ea03356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:36.699358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056dcc2-c81c-49b3-9cbd-48e60ea03356 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:36.699358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056dcc2-c81c-49b3-9cbd-48e60ea03356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:36.699358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056dcc2-c81c-49b3-9cbd-48e60ea03356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:36.699358 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056dcc2-c81c-49b3-9cbd-48e60ea03356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:36.699706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056dcc2-c81c-49b3-9cbd-48e60ea03356 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:36.713656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1367/2768] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:36.718059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c806a-db72-4395-85f6-60a8a06e6234 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:36.729674 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c806a-db72-4395-85f6-60a8a06e6234 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:36.734722 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3937fbe-a294-4c6d-a2e6-c78ed200686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:36.735889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937fbe-a294-4c6d-a2e6-c78ed200686f admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:36.736030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937fbe-a294-4c6d-a2e6-c78ed200686f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:36.736385 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937fbe-a294-4c6d-a2e6-c78ed200686f admin admin] PATH_INFO: `/v3/projects/b94dab773917439d83b90d403c12f1cd/users/3333873322e9431bbaf60125c3a43ab7/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:36.765834 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3937fbe-a294-4c6d-a2e6-c78ed200686f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94dab773917439d83b90d403c12f1cd, user_id=3333873322e9431bbaf60125c3a43ab7, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:36.768687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3937fbe-a294-4c6d-a2e6-c78ed200686f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:36.842046 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1402/2769] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:57:36 2022] PUT /identity/v3/projects/b94dab773917439d83b90d403c12f1cd/users/3333873322e9431bbaf60125c3a43ab7/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:57:36.852877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17dd6-31c9-41e8-a10a-3ffce3d0cc19 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:36.853232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17dd6-31c9-41e8-a10a-3ffce3d0cc19 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:36.853447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17dd6-31c9-41e8-a10a-3ffce3d0cc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:36.884074 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-9fd17dd6-31c9-41e8-a10a-3ffce3d0cc19 None None] MFA Rules not processed for user `3333873322e9431bbaf60125c3a43ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:36.885565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9fd17dd6-31c9-41e8-a10a-3ffce3d0cc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:36.962902 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1368/2770] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:36.964110 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3937fbe-a294-4c6d-a2e6-c78ed200686f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:37.000660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:37.033669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3937fbe-a294-4c6d-a2e6-c78ed200686f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:37.040771 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c418-866a-454b-890d-25ec51149040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:37.041531 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c418-866a-454b-890d-25ec51149040 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:37.041873 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c418-866a-454b-890d-25ec51149040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:37.042203 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c418-866a-454b-890d-25ec51149040 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:37.042896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096c418-866a-454b-890d-25ec51149040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:37.044853 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096c418-866a-454b-890d-25ec51149040 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:37.147511 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1403/2771] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:57:36 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:37.148889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17dd6-31c9-41e8-a10a-3ffce3d0cc19 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:37.160200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17dd6-31c9-41e8-a10a-3ffce3d0cc19 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:37.220156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:37.257106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb05a-4c73-4b15-aa9a-51c79f2592ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:37.257802 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb05a-4c73-4b15-aa9a-51c79f2592ab admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:37.258086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb05a-4c73-4b15-aa9a-51c79f2592ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:37.258364 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb05a-4c73-4b15-aa9a-51c79f2592ab admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:37.259073 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accb05a-4c73-4b15-aa9a-51c79f2592ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:37.262845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accb05a-4c73-4b15-aa9a-51c79f2592ab admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:37.386576 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1369/2772] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:57:37 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:37.390414 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c418-866a-454b-890d-25ec51149040 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:37.401733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c418-866a-454b-890d-25ec51149040 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:37.406608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d4244-97a1-4915-b396-f3688246f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:37.407287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d4244-97a1-4915-b396-f3688246f347 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:37.407573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d4244-97a1-4915-b396-f3688246f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:37.407849 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d4244-97a1-4915-b396-f3688246f347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:37.408617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d4244-97a1-4915-b396-f3688246f347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:37.410320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d4244-97a1-4915-b396-f3688246f347 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:37.428712 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb05a-4c73-4b15-aa9a-51c79f2592ab admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:37.433992 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1404/2773] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:37.439833 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb05a-4c73-4b15-aa9a-51c79f2592ab admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:37.445338 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810317-f10c-4c64-880d-ff6507bc0abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:37.446230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810317-f10c-4c64-880d-ff6507bc0abe admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:37.446516 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810317-f10c-4c64-880d-ff6507bc0abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:37.446798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810317-f10c-4c64-880d-ff6507bc0abe admin admin] PATH_INFO: `/v3/projects/26585e72fe6a46738dba6c5785eb5c97/users/d14979a67469427c8ca3e76b1d53c09a/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:37.465944 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810317-f10c-4c64-880d-ff6507bc0abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=26585e72fe6a46738dba6c5785eb5c97, user_id=d14979a67469427c8ca3e76b1d53c09a, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:37.468857 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810317-f10c-4c64-880d-ff6507bc0abe admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:37.556005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1370/2774] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:57:37 2022] PUT /identity/v3/projects/26585e72fe6a46738dba6c5785eb5c97/users/d14979a67469427c8ca3e76b1d53c09a/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:37.561832 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d4244-97a1-4915-b396-f3688246f347 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:37.572597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d4244-97a1-4915-b396-f3688246f347 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:37.661380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5427f-7c68-45be-b983-636a3dcaebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:37.662341 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5427f-7c68-45be-b983-636a3dcaebca admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:37.662713 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5427f-7c68-45be-b983-636a3dcaebca admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:37.663068 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5427f-7c68-45be-b983-636a3dcaebca admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:37.663874 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5427f-7c68-45be-b983-636a3dcaebca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:37.665741 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5427f-7c68-45be-b983-636a3dcaebca admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:37.680488 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1405/2775] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:37.684345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810317-f10c-4c64-880d-ff6507bc0abe admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:37.696267 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810317-f10c-4c64-880d-ff6507bc0abe admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:37.702263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe487a-9c5d-4bcd-acc0-498c97999d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:37.703519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe487a-9c5d-4bcd-acc0-498c97999d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:37.703908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe487a-9c5d-4bcd-acc0-498c97999d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:37.704283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe487a-9c5d-4bcd-acc0-498c97999d9b admin admin] PATH_INFO: `/v3/projects/26585e72fe6a46738dba6c5785eb5c97/users/d14979a67469427c8ca3e76b1d53c09a/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:37.706893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe487a-9c5d-4bcd-acc0-498c97999d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26585e72fe6a46738dba6c5785eb5c97, user_id=d14979a67469427c8ca3e76b1d53c09a, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:37.710489 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe487a-9c5d-4bcd-acc0-498c97999d9b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:37.724007 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1371/2776] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:57:37 2022] PUT /identity/v3/projects/26585e72fe6a46738dba6c5785eb5c97/users/d14979a67469427c8ca3e76b1d53c09a/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:57:37.735237 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b496-7ad7-4852-aede-e02e6503685f None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:37.735526 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b496-7ad7-4852-aede-e02e6503685f None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:37.736007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b496-7ad7-4852-aede-e02e6503685f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:37.768513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-13a1b496-7ad7-4852-aede-e02e6503685f None None] MFA Rules not processed for user `d14979a67469427c8ca3e76b1d53c09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:37.769730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-13a1b496-7ad7-4852-aede-e02e6503685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:37.860096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1406/2777] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:37.875928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe487a-9c5d-4bcd-acc0-498c97999d9b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:37.879225 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-4cbe487a-9c5d-4bcd-acc0-498c97999d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:37.971182 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe487a-9c5d-4bcd-acc0-498c97999d9b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:37.979004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618683-fc3f-42fc-81c1-3d02ef2a8834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:37.979004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618683-fc3f-42fc-81c1-3d02ef2a8834 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:37.979004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618683-fc3f-42fc-81c1-3d02ef2a8834 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:37.979004 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618683-fc3f-42fc-81c1-3d02ef2a8834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:37.992956 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c618683-fc3f-42fc-81c1-3d02ef2a8834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:37.994418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c618683-fc3f-42fc-81c1-3d02ef2a8834 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:38.007353 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1372/2778] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:38.227684 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1b496-7ad7-4852-aede-e02e6503685f None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:38.242141 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1b496-7ad7-4852-aede-e02e6503685f None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:38.246423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424a6b1-6a59-4b81-8bae-b39d88fe7f35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:38.247086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424a6b1-6a59-4b81-8bae-b39d88fe7f35 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:38.248710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424a6b1-6a59-4b81-8bae-b39d88fe7f35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:38.248710 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424a6b1-6a59-4b81-8bae-b39d88fe7f35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:38.280778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:38.323152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424a6b1-6a59-4b81-8bae-b39d88fe7f35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:38.325763 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424a6b1-6a59-4b81-8bae-b39d88fe7f35 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:38.337287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1407/2779] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:41.807411 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618683-fc3f-42fc-81c1-3d02ef2a8834 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:41.882171 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618683-fc3f-42fc-81c1-3d02ef2a8834 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:41.887670 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:41.888845 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:41.889332 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:41.889805 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] PATH_INFO: `/v3/users/3333873322e9431bbaf60125c3a43ab7` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:41.891220 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3333873322e9431bbaf60125c3a43ab7)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:41.893451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:42.076849 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:42.085148 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3333873322e9431bbaf60125c3a43ab7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:42.085914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3333873322e9431bbaf60125c3a43ab7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:42.095451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3333873322e9431bbaf60125c3a43ab7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:42.111862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3333873322e9431bbaf60125c3a43ab7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:42.212328 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3333873322e9431bbaf60125c3a43ab7'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:42.222483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1373/2780] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:57:41 2022] DELETE /identity/v3/users/3333873322e9431bbaf60125c3a43ab7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:42.227703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269303d7-dd94-4314-84b5-95022c2d2762 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:42.228273 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269303d7-dd94-4314-84b5-95022c2d2762 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:42.228518 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269303d7-dd94-4314-84b5-95022c2d2762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:42.247487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-269303d7-dd94-4314-84b5-95022c2d2762 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:42.248772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-269303d7-dd94-4314-84b5-95022c2d2762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:42.318665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1408/2781] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:42.328573 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:42.329956 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:42.389859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781615b-0035-435f-9fbb-984b219b2642 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:42.393739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c64c73-6dac-4c54-a523-dd906d90c68c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:42.394394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c64c73-6dac-4c54-a523-dd906d90c68c service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:42.394673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c64c73-6dac-4c54-a523-dd906d90c68c service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:42.394946 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c64c73-6dac-4c54-a523-dd906d90c68c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:42.406747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c64c73-6dac-4c54-a523-dd906d90c68c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:42.408240 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c64c73-6dac-4c54-a523-dd906d90c68c service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:42.418889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1374/2782] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:43.178499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269303d7-dd94-4314-84b5-95022c2d2762 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:43.180156 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-269303d7-dd94-4314-84b5-95022c2d2762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:43.241730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269303d7-dd94-4314-84b5-95022c2d2762 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:43.247020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:43.247886 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:43.248172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:43.248484 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] PATH_INFO: `/v3/projects/b94dab773917439d83b90d403c12f1cd` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:43.249745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94dab773917439d83b90d403c12f1cd)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:43.251669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:43.374871 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94dab773917439d83b90d403c12f1cd', 'request_id': 'req-135f6128-5d14-419c-aede-baea1a99964d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.382061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94dab773917439d83b90d403c12f1cd', 'request_id': 'req-135f6128-5d14-419c-aede-baea1a99964d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.462377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94dab773917439d83b90d403c12f1cd', 'request_id': 'req-135f6128-5d14-419c-aede-baea1a99964d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.478762 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] The token cache is being invalidate because project b94dab773917439d83b90d403c12f1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:57:43.479225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.479946 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.485344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1409/2783] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:57:43 2022] DELETE /identity/v3/projects/b94dab773917439d83b90d403c12f1cd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:43.486263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c64c73-6dac-4c54-a523-dd906d90c68c service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:43.509437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c64c73-6dac-4c54-a523-dd906d90c68c service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:43.575543 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:43.576459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:43.576762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:43.577019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] PATH_INFO: `/v3/users/d14979a67469427c8ca3e76b1d53c09a` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:43.578580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14979a67469427c8ca3e76b1d53c09a)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:43.580571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:43.772465 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14979a67469427c8ca3e76b1d53c09a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.773208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14979a67469427c8ca3e76b1d53c09a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.778487 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:43.782677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14979a67469427c8ca3e76b1d53c09a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.796792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14979a67469427c8ca3e76b1d53c09a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.868504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6e2bfb06-d758-43f6-9a6d-5edca24f9f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14979a67469427c8ca3e76b1d53c09a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:43.878765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1375/2784] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:57:43 2022] DELETE /identity/v3/users/d14979a67469427c8ca3e76b1d53c09a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:57:44.347579 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:44.349957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:44.364828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f6128-5d14-419c-aede-baea1a99964d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:44.406267 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:44.447910 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:44.448904 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:44.449221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:44.449508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] PATH_INFO: `/v3/projects/26585e72fe6a46738dba6c5785eb5c97` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:44.450758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26585e72fe6a46738dba6c5785eb5c97)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:44.452914 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:44.580859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26585e72fe6a46738dba6c5785eb5c97', 'request_id': 'req-3db24dbf-4f85-43bc-84b5-7c74abe57021'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:44.587391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26585e72fe6a46738dba6c5785eb5c97', 'request_id': 'req-3db24dbf-4f85-43bc-84b5-7c74abe57021'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:44.656155 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26585e72fe6a46738dba6c5785eb5c97', 'request_id': 'req-3db24dbf-4f85-43bc-84b5-7c74abe57021'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:44.671311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] The token cache is being invalidate because project 26585e72fe6a46738dba6c5785eb5c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:57:44.671635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:44.672322 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-3db24dbf-4f85-43bc-84b5-7c74abe57021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:44.677825 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1410/2785] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:57:44 2022] DELETE /identity/v3/projects/26585e72fe6a46738dba6c5785eb5c97 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:44.679917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2def5dc-8edc-4f3f-a16e-369a3523cc2f None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:44.680432 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2def5dc-8edc-4f3f-a16e-369a3523cc2f None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:44.680639 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2def5dc-8edc-4f3f-a16e-369a3523cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:44.714983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c2def5dc-8edc-4f3f-a16e-369a3523cc2f None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:44.716921 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c2def5dc-8edc-4f3f-a16e-369a3523cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:44.783160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1376/2786] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:44.792584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52b01-7c6e-4a41-b8b3-b9736b4e1085 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:44.793065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52b01-7c6e-4a41-b8b3-b9736b4e1085 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:44.793430 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52b01-7c6e-4a41-b8b3-b9736b4e1085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:44.814116 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-12a52b01-7c6e-4a41-b8b3-b9736b4e1085 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:44.815390 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-12a52b01-7c6e-4a41-b8b3-b9736b4e1085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:44.825303 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1411/2787] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:44.829315 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2def5dc-8edc-4f3f-a16e-369a3523cc2f None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:44.840062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2def5dc-8edc-4f3f-a16e-369a3523cc2f None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:44.845096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7188af7-fada-40da-b54e-ab27d90ca1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:44.845771 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7188af7-fada-40da-b54e-ab27d90ca1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:44.846061 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7188af7-fada-40da-b54e-ab27d90ca1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:44.846346 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7188af7-fada-40da-b54e-ab27d90ca1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:44.847069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7188af7-fada-40da-b54e-ab27d90ca1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:44.847667 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7188af7-fada-40da-b54e-ab27d90ca1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:44.849384 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7188af7-fada-40da-b54e-ab27d90ca1ab admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:44.861839 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1377/2788] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:44.866960 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52b01-7c6e-4a41-b8b3-b9736b4e1085 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:44.877636 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52b01-7c6e-4a41-b8b3-b9736b4e1085 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:44.883632 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623988c-f28b-4392-945a-e5d510141d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:44.884324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623988c-f28b-4392-945a-e5d510141d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:44.884612 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623988c-f28b-4392-945a-e5d510141d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:44.884895 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623988c-f28b-4392-945a-e5d510141d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:44.885590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623988c-f28b-4392-945a-e5d510141d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:44.887539 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623988c-f28b-4392-945a-e5d510141d04 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:44.977745 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1412/2789] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:57:44 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:44.978460 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7188af7-fada-40da-b54e-ab27d90ca1ab admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:44.989646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7188af7-fada-40da-b54e-ab27d90ca1ab admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:45.058453 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16abbad-eb8c-41f3-9727-42e6f5e1d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:45.059181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16abbad-eb8c-41f3-9727-42e6f5e1d585 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:45.059469 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16abbad-eb8c-41f3-9727-42e6f5e1d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:45.059739 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16abbad-eb8c-41f3-9727-42e6f5e1d585 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:45.060467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16abbad-eb8c-41f3-9727-42e6f5e1d585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:45.062433 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16abbad-eb8c-41f3-9727-42e6f5e1d585 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:45.162488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1378/2790] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:57:44 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:45.166672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623988c-f28b-4392-945a-e5d510141d04 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:45.178585 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623988c-f28b-4392-945a-e5d510141d04 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:45.185198 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04445d-af73-4951-a06c-53d17f1af7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:45.191299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04445d-af73-4951-a06c-53d17f1af7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:45.191299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04445d-af73-4951-a06c-53d17f1af7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:45.191299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04445d-af73-4951-a06c-53d17f1af7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:45.191299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04445d-af73-4951-a06c-53d17f1af7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:45.191299 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04445d-af73-4951-a06c-53d17f1af7d8 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:45.206912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1413/2791] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:45.211703 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16abbad-eb8c-41f3-9727-42e6f5e1d585 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:45.222886 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16abbad-eb8c-41f3-9727-42e6f5e1d585 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:45.228909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578bce2-30a0-4855-812c-18a0d7f29a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:45.229586 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578bce2-30a0-4855-812c-18a0d7f29a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:45.229888 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578bce2-30a0-4855-812c-18a0d7f29a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:45.230178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578bce2-30a0-4855-812c-18a0d7f29a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:45.230898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578bce2-30a0-4855-812c-18a0d7f29a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:45.232660 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578bce2-30a0-4855-812c-18a0d7f29a65 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:45.244241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1379/2792] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:45.248083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04445d-af73-4951-a06c-53d17f1af7d8 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:45.259352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04445d-af73-4951-a06c-53d17f1af7d8 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:45.264114 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a4db5-2a1f-464c-a8f9-ebd229016831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:45.265273 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a4db5-2a1f-464c-a8f9-ebd229016831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:45.265600 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a4db5-2a1f-464c-a8f9-ebd229016831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:45.265842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a4db5-2a1f-464c-a8f9-ebd229016831 admin admin] PATH_INFO: `/v3/projects/b1c261ba0e7c4106b2c844378db69230/users/8f68c63e00034ccf84ad76fead4b10d6/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:45.283419 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a4db5-2a1f-464c-a8f9-ebd229016831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c261ba0e7c4106b2c844378db69230, user_id=8f68c63e00034ccf84ad76fead4b10d6, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:45.286608 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a4db5-2a1f-464c-a8f9-ebd229016831 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:45.361022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1414/2793] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:57:45 2022] PUT /identity/v3/projects/b1c261ba0e7c4106b2c844378db69230/users/8f68c63e00034ccf84ad76fead4b10d6/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:45.372533 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd30e57-b4ed-474c-8471-1556d715d987 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:45.373099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd30e57-b4ed-474c-8471-1556d715d987 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:45.373279 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd30e57-b4ed-474c-8471-1556d715d987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:45.403889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-1dd30e57-b4ed-474c-8471-1556d715d987 None None] MFA Rules not processed for user `8f68c63e00034ccf84ad76fead4b10d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:45.405162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1dd30e57-b4ed-474c-8471-1556d715d987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:45.426193 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:45.483580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1380/2794] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:45.488412 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a4db5-2a1f-464c-a8f9-ebd229016831 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:45.552938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:45.558348 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a4db5-2a1f-464c-a8f9-ebd229016831 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:45.568086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3ed93-ac30-43f4-8cce-0e810a05bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:45.568782 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3ed93-ac30-43f4-8cce-0e810a05bd9f admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:45.569069 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3ed93-ac30-43f4-8cce-0e810a05bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:45.569350 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3ed93-ac30-43f4-8cce-0e810a05bd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:45.570138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3ed93-ac30-43f4-8cce-0e810a05bd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:45.572277 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3ed93-ac30-43f4-8cce-0e810a05bd9f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:45.881911 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1415/2795] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:57:45 2022] POST /identity/v3/projects => generated 387 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:45.886071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd30e57-b4ed-474c-8471-1556d715d987 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:45.897512 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd30e57-b4ed-474c-8471-1556d715d987 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:45.962740 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2eba-6bb5-416c-bc04-ef48cb10e7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:45.963437 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2eba-6bb5-416c-bc04-ef48cb10e7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:45.963726 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2eba-6bb5-416c-bc04-ef48cb10e7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:45.964005 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2eba-6bb5-416c-bc04-ef48cb10e7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:45.965080 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c2eba-6bb5-416c-bc04-ef48cb10e7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:45.967090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c2eba-6bb5-416c-bc04-ef48cb10e7aa admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:46.046978 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1381/2796] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:57:45 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:46.051090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3ed93-ac30-43f4-8cce-0e810a05bd9f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:46.063111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3ed93-ac30-43f4-8cce-0e810a05bd9f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:46.070405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75da4f-e377-478a-a88b-ee279f08f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:46.070405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75da4f-e377-478a-a88b-ee279f08f808 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:46.070405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75da4f-e377-478a-a88b-ee279f08f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:46.070405 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75da4f-e377-478a-a88b-ee279f08f808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:46.070863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75da4f-e377-478a-a88b-ee279f08f808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:46.072134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75da4f-e377-478a-a88b-ee279f08f808 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:46.084090 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1416/2797] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:46.091141 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2eba-6bb5-416c-bc04-ef48cb10e7aa admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:46.102877 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2eba-6bb5-416c-bc04-ef48cb10e7aa admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:46.107714 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca7bed-6deb-4e6a-b71d-0c9a076a6e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:46.108664 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca7bed-6deb-4e6a-b71d-0c9a076a6e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:46.108977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca7bed-6deb-4e6a-b71d-0c9a076a6e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:46.109261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca7bed-6deb-4e6a-b71d-0c9a076a6e99 admin admin] PATH_INFO: `/v3/projects/9f34a78634804b02be0a2b49829b4cb5/users/00373fa7e7d04b1284b0454985b57909/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:46.128522 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca7bed-6deb-4e6a-b71d-0c9a076a6e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f34a78634804b02be0a2b49829b4cb5, user_id=00373fa7e7d04b1284b0454985b57909, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:46.131258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca7bed-6deb-4e6a-b71d-0c9a076a6e99 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:46.192525 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1382/2798] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:57:46 2022] PUT /identity/v3/projects/9f34a78634804b02be0a2b49829b4cb5/users/00373fa7e7d04b1284b0454985b57909/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:46.196549 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75da4f-e377-478a-a88b-ee279f08f808 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:46.208625 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75da4f-e377-478a-a88b-ee279f08f808 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:46.278807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15515430-477b-46a7-9846-ec54f894032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:46.279508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15515430-477b-46a7-9846-ec54f894032c admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:46.279790 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15515430-477b-46a7-9846-ec54f894032c admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:46.280064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15515430-477b-46a7-9846-ec54f894032c admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:46.280828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15515430-477b-46a7-9846-ec54f894032c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:46.282486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15515430-477b-46a7-9846-ec54f894032c admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:46.294708 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1417/2799] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:46.298923 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca7bed-6deb-4e6a-b71d-0c9a076a6e99 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:46.310542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca7bed-6deb-4e6a-b71d-0c9a076a6e99 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:46.315410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b326f3-7616-4fcd-b29c-ef9d4e664c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:46.316318 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b326f3-7616-4fcd-b29c-ef9d4e664c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:46.316604 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b326f3-7616-4fcd-b29c-ef9d4e664c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:46.316898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b326f3-7616-4fcd-b29c-ef9d4e664c08 admin admin] PATH_INFO: `/v3/projects/9f34a78634804b02be0a2b49829b4cb5/users/00373fa7e7d04b1284b0454985b57909/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:46.318832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b326f3-7616-4fcd-b29c-ef9d4e664c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f34a78634804b02be0a2b49829b4cb5, user_id=00373fa7e7d04b1284b0454985b57909, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:46.321754 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b326f3-7616-4fcd-b29c-ef9d4e664c08 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:46.336011 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1383/2800] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:57:46 2022] PUT /identity/v3/projects/9f34a78634804b02be0a2b49829b4cb5/users/00373fa7e7d04b1284b0454985b57909/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:57:46.348561 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870319-f50d-46b7-8608-21a437a9a310 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:46.349021 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870319-f50d-46b7-8608-21a437a9a310 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:46.349401 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870319-f50d-46b7-8608-21a437a9a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:46.380191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-7a870319-f50d-46b7-8608-21a437a9a310 None None] MFA Rules not processed for user `00373fa7e7d04b1284b0454985b57909`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:46.388725 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7a870319-f50d-46b7-8608-21a437a9a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:46.468251 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1418/2801] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:46.480820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b326f3-7616-4fcd-b29c-ef9d4e664c08 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:46.482761 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-81b326f3-7616-4fcd-b29c-ef9d4e664c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:46.552152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b326f3-7616-4fcd-b29c-ef9d4e664c08 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:46.556955 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab1c53-5ed5-4218-a455-ad669d61583a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:46.557777 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab1c53-5ed5-4218-a455-ad669d61583a service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:46.558215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab1c53-5ed5-4218-a455-ad669d61583a service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:46.558665 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab1c53-5ed5-4218-a455-ad669d61583a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:46.577507 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab1c53-5ed5-4218-a455-ad669d61583a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:46.579184 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab1c53-5ed5-4218-a455-ad669d61583a service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:46.590652 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1384/2802] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:46.662210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870319-f50d-46b7-8608-21a437a9a310 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:46.715929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:46.729129 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870319-f50d-46b7-8608-21a437a9a310 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:46.733688 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:46.734655 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:46.734867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:46.735147 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] PATH_INFO: `/v3/users/8f68c63e00034ccf84ad76fead4b10d6` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:46.736382 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f68c63e00034ccf84ad76fead4b10d6)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:46.738365 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:46.927261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f68c63e00034ccf84ad76fead4b10d6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:46.988411 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f68c63e00034ccf84ad76fead4b10d6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:46.989086 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f68c63e00034ccf84ad76fead4b10d6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:46.992772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f68c63e00034ccf84ad76fead4b10d6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:47.001191 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f68c63e00034ccf84ad76fead4b10d6'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:47.019836 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1419/2803] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:57:46 2022] DELETE /identity/v3/users/8f68c63e00034ccf84ad76fead4b10d6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:47.024236 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a508e-51af-4156-9c25-e0e2a73a54a8 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:47.024731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a508e-51af-4156-9c25-e0e2a73a54a8 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:47.024832 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a508e-51af-4156-9c25-e0e2a73a54a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:47.042232 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-a05a508e-51af-4156-9c25-e0e2a73a54a8 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:47.043403 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a05a508e-51af-4156-9c25-e0e2a73a54a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:47.051282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:47.101518 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1385/2804] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:57:47.111309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:47.112844 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:47.190332 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786130-9eac-4fbe-b243-d60e5c12107b admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:47.194032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e7269-7935-45da-9101-ac5bcc75d3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:47.195234 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e7269-7935-45da-9101-ac5bcc75d3bf service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:47.195716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e7269-7935-45da-9101-ac5bcc75d3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:47.196035 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e7269-7935-45da-9101-ac5bcc75d3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:47.205406 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e7269-7935-45da-9101-ac5bcc75d3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:47.207139 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e7269-7935-45da-9101-ac5bcc75d3bf service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:47.217466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1420/2805] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:47.590517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a508e-51af-4156-9c25-e0e2a73a54a8 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:47.592002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a05a508e-51af-4156-9c25-e0e2a73a54a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:47.609924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a508e-51af-4156-9c25-e0e2a73a54a8 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:47.615977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:47.618504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:47.619323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:47.620151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] PATH_INFO: `/v3/projects/b1c261ba0e7c4106b2c844378db69230` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:47.621603 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c261ba0e7c4106b2c844378db69230)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:47.623540 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:47.737167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c261ba0e7c4106b2c844378db69230', 'request_id': 'req-9a8899b9-2ee0-4b02-b30e-19354376ec21'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:47.800167 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c261ba0e7c4106b2c844378db69230', 'request_id': 'req-9a8899b9-2ee0-4b02-b30e-19354376ec21'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:47.807965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c261ba0e7c4106b2c844378db69230', 'request_id': 'req-9a8899b9-2ee0-4b02-b30e-19354376ec21'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:47.821269 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] The token cache is being invalidate because project b1c261ba0e7c4106b2c844378db69230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:57:47.821693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:47.822439 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-9a8899b9-2ee0-4b02-b30e-19354376ec21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:47.824108 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1386/2806] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:57:47 2022] DELETE /identity/v3/projects/b1c261ba0e7c4106b2c844378db69230 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:47.828181 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e7269-7935-45da-9101-ac5bcc75d3bf service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:47.842646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e7269-7935-45da-9101-ac5bcc75d3bf service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:47.905309 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:47.905626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5b16-8212-4029-8b55-311ee80f55de None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:47.905626 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5b16-8212-4029-8b55-311ee80f55de None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:47.906000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5b16-8212-4029-8b55-311ee80f55de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:47.907646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:47.908552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:47.908842 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:47.909154 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] PATH_INFO: `/v3/users/00373fa7e7d04b1284b0454985b57909` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:47.910400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00373fa7e7d04b1284b0454985b57909)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:47.912353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:47.925656 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c65e5b16-8212-4029-8b55-311ee80f55de None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:47.927268 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c65e5b16-8212-4029-8b55-311ee80f55de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:47.985280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1387/2807] 10.222.0.74 () {58 vars in 967 bytes} [Mon May 23 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:57:47.998168 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e5b16-8212-4029-8b55-311ee80f55de None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:47.999491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c65e5b16-8212-4029-8b55-311ee80f55de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:48.044723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:48.068744 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e5b16-8212-4029-8b55-311ee80f55de None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:48.074820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5cb3f-fd9e-4439-a357-78ca5406d585 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:48.075468 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5cb3f-fd9e-4439-a357-78ca5406d585 service swift] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:48.075753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5cb3f-fd9e-4439-a357-78ca5406d585 service swift] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:48.076029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5cb3f-fd9e-4439-a357-78ca5406d585 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:48.085568 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5cb3f-fd9e-4439-a357-78ca5406d585 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:48.087170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5cb3f-fd9e-4439-a357-78ca5406d585 service swift] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:48.095804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1388/2808] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:57:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:57:48.100761 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00373fa7e7d04b1284b0454985b57909'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.188991 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00373fa7e7d04b1284b0454985b57909'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.189543 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00373fa7e7d04b1284b0454985b57909'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.190174 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00373fa7e7d04b1284b0454985b57909'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.204331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-4054d31f-603c-49ca-a3b2-caae6f66d55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00373fa7e7d04b1284b0454985b57909'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.219641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1421/2809] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:57:47 2022] DELETE /identity/v3/users/00373fa7e7d04b1284b0454985b57909 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:48.657760 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5cb3f-fd9e-4439-a357-78ca5406d585 service swift] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:48.663348 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e1d5cb3f-fd9e-4439-a357-78ca5406d585 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:48.674808 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5cb3f-fd9e-4439-a357-78ca5406d585 service swift] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:48.734854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:48.735649 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:48.735930 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:48.736208 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] PATH_INFO: `/v3/projects/9f34a78634804b02be0a2b49829b4cb5` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:48.737409 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f34a78634804b02be0a2b49829b4cb5)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:48.739321 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:48.836000 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f34a78634804b02be0a2b49829b4cb5', 'request_id': 'req-0d388008-3046-4162-b0d2-2dd3c6884a9a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.874325 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f34a78634804b02be0a2b49829b4cb5', 'request_id': 'req-0d388008-3046-4162-b0d2-2dd3c6884a9a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.880977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f34a78634804b02be0a2b49829b4cb5', 'request_id': 'req-0d388008-3046-4162-b0d2-2dd3c6884a9a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.892402 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] The token cache is being invalidate because project 9f34a78634804b02be0a2b49829b4cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:57:48.892693 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.893310 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0d388008-3046-4162-b0d2-2dd3c6884a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:48.894846 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1389/2810] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:57:48 2022] DELETE /identity/v3/projects/9f34a78634804b02be0a2b49829b4cb5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:48.900029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00b46-2b7b-42e6-adbf-eec416869383 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:48.900536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00b46-2b7b-42e6-adbf-eec416869383 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:48.900660 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00b46-2b7b-42e6-adbf-eec416869383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:48.919897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-45b00b46-2b7b-42e6-adbf-eec416869383 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:48.921134 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-45b00b46-2b7b-42e6-adbf-eec416869383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:48.982102 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1422/2811] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:48.990132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615b72-6ce1-4af1-8764-3e8d48b9bc35 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:48.990361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615b72-6ce1-4af1-8764-3e8d48b9bc35 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:48.990672 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615b72-6ce1-4af1-8764-3e8d48b9bc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:49.010243 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-88615b72-6ce1-4af1-8764-3e8d48b9bc35 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:49.011447 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-88615b72-6ce1-4af1-8764-3e8d48b9bc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:49.019621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1390/2812] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:49.024469 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00b46-2b7b-42e6-adbf-eec416869383 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:49.034133 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00b46-2b7b-42e6-adbf-eec416869383 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:49.039663 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63405a86-1a65-4d6b-affc-c37d2ed6ee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:49.040319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63405a86-1a65-4d6b-affc-c37d2ed6ee7f admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:49.040611 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63405a86-1a65-4d6b-affc-c37d2ed6ee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:49.040889 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63405a86-1a65-4d6b-affc-c37d2ed6ee7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:49.041621 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63405a86-1a65-4d6b-affc-c37d2ed6ee7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:49.041933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63405a86-1a65-4d6b-affc-c37d2ed6ee7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:49.043537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63405a86-1a65-4d6b-affc-c37d2ed6ee7f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:49.055793 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1423/2813] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:49.060016 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615b72-6ce1-4af1-8764-3e8d48b9bc35 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:49.069981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615b72-6ce1-4af1-8764-3e8d48b9bc35 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:49.074985 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d6cb0-d242-4120-8e4f-a8a22f2abf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:49.075688 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d6cb0-d242-4120-8e4f-a8a22f2abf86 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:49.076032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d6cb0-d242-4120-8e4f-a8a22f2abf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:49.076342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d6cb0-d242-4120-8e4f-a8a22f2abf86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:49.077044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d6cb0-d242-4120-8e4f-a8a22f2abf86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:49.079106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d6cb0-d242-4120-8e4f-a8a22f2abf86 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:49.167972 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1391/2814] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:57:49 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:57:49.172306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63405a86-1a65-4d6b-affc-c37d2ed6ee7f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:49.182641 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63405a86-1a65-4d6b-affc-c37d2ed6ee7f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:49.248803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d324b-6999-49ea-860a-496c19aedd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:49.249486 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d324b-6999-49ea-860a-496c19aedd99 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:49.249775 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d324b-6999-49ea-860a-496c19aedd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:49.250113 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d324b-6999-49ea-860a-496c19aedd99 admin admin] PATH_INFO: `/v3/users` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:49.250808 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d324b-6999-49ea-860a-496c19aedd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:49.252797 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d324b-6999-49ea-860a-496c19aedd99 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:49.259848 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:49.338202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1424/2815] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:57:49 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:49.342115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d6cb0-d242-4120-8e4f-a8a22f2abf86 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:49.353698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d6cb0-d242-4120-8e4f-a8a22f2abf86 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:49.358454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d10e63-656a-4b5e-9063-e06184ed84af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:49.359090 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d10e63-656a-4b5e-9063-e06184ed84af admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:49.359379 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d10e63-656a-4b5e-9063-e06184ed84af admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:49.359659 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d10e63-656a-4b5e-9063-e06184ed84af admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:49.360420 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d10e63-656a-4b5e-9063-e06184ed84af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:49.362069 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d10e63-656a-4b5e-9063-e06184ed84af admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:49.373132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1392/2816] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:49.377066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d324b-6999-49ea-860a-496c19aedd99 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:49.388064 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d324b-6999-49ea-860a-496c19aedd99 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:49.392949 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a55c5b-d270-45dd-aa9c-e018e2142e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:49.393603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a55c5b-d270-45dd-aa9c-e018e2142e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:49.393909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a55c5b-d270-45dd-aa9c-e018e2142e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:49.394171 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a55c5b-d270-45dd-aa9c-e018e2142e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:49.394900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a55c5b-d270-45dd-aa9c-e018e2142e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:49.396535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a55c5b-d270-45dd-aa9c-e018e2142e68 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:49.407767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1425/2817] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:49.411910 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d10e63-656a-4b5e-9063-e06184ed84af admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:49.422072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d10e63-656a-4b5e-9063-e06184ed84af admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:49.426807 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05752-07f1-47d5-9a6b-5ace5231de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:49.432282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05752-07f1-47d5-9a6b-5ace5231de6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:49.432282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05752-07f1-47d5-9a6b-5ace5231de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:49.432282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05752-07f1-47d5-9a6b-5ace5231de6d admin admin] PATH_INFO: `/v3/projects/7a9730ee93674e42a43bdb1c9ff50354/users/a0f63c7ed531446786ad9d01d941d991/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:49.444027 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c05752-07f1-47d5-9a6b-5ace5231de6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9730ee93674e42a43bdb1c9ff50354, user_id=a0f63c7ed531446786ad9d01d941d991, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:49.447282 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c05752-07f1-47d5-9a6b-5ace5231de6d admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:49.560965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:49.566705 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1393/2818] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:57:49 2022] PUT /identity/v3/projects/7a9730ee93674e42a43bdb1c9ff50354/users/a0f63c7ed531446786ad9d01d941d991/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:49.577635 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9b278-e552-4e86-8035-00c30f1379f0 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:49.577925 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9b278-e552-4e86-8035-00c30f1379f0 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:49.578206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9b278-e552-4e86-8035-00c30f1379f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:49.605230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8be9b278-e552-4e86-8035-00c30f1379f0 None None] MFA Rules not processed for user `a0f63c7ed531446786ad9d01d941d991`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:49.606457 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8be9b278-e552-4e86-8035-00c30f1379f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:49.672217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1426/2819] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:49.683743 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05752-07f1-47d5-9a6b-5ace5231de6d admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:49.685514 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-07c05752-07f1-47d5-9a6b-5ace5231de6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:49.746375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05752-07f1-47d5-9a6b-5ace5231de6d admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:49.750060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d789de8-e393-4d70-93c3-c99f1475a76b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:49.750698 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d789de8-e393-4d70-93c3-c99f1475a76b service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:49.750977 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d789de8-e393-4d70-93c3-c99f1475a76b service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:49.751249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d789de8-e393-4d70-93c3-c99f1475a76b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:49.760366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d789de8-e393-4d70-93c3-c99f1475a76b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:49.763943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d789de8-e393-4d70-93c3-c99f1475a76b service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:49.770454 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1394/2820] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:50.845497 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9b278-e552-4e86-8035-00c30f1379f0 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:50.846930 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8be9b278-e552-4e86-8035-00c30f1379f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:50.918495 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9b278-e552-4e86-8035-00c30f1379f0 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:50.923768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6540157-ea72-439d-a207-4296d5608192 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:50.924456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540157-ea72-439d-a207-4296d5608192 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:50.924739 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540157-ea72-439d-a207-4296d5608192 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:50.925010 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540157-ea72-439d-a207-4296d5608192 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:50.926758 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-a6540157-ea72-439d-a207-4296d5608192 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:50.938944 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6540157-ea72-439d-a207-4296d5608192 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:50.940587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6540157-ea72-439d-a207-4296d5608192 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:50.951070 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d789de8-e393-4d70-93c3-c99f1475a76b service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:50.952415 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1427/2821] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:50.954486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3d789de8-e393-4d70-93c3-c99f1475a76b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:51.028520 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d789de8-e393-4d70-93c3-c99f1475a76b service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:51.033033 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:51.033896 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:51.034178 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:51.034451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] PATH_INFO: `/v3/users/b78d8e7ea1c24cc5ba664b410e7ed39a` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:51.035624 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78d8e7ea1c24cc5ba664b410e7ed39a)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:51.037588 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:51.290133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78d8e7ea1c24cc5ba664b410e7ed39a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.290787 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78d8e7ea1c24cc5ba664b410e7ed39a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.297731 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78d8e7ea1c24cc5ba664b410e7ed39a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.310047 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78d8e7ea1c24cc5ba664b410e7ed39a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.403998 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-83974469-8a79-475c-ac7b-c1dca125969e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78d8e7ea1c24cc5ba664b410e7ed39a'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.410736 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1395/2822] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:57:50 2022] DELETE /identity/v3/users/b78d8e7ea1c24cc5ba664b410e7ed39a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:57:51.653328 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6540157-ea72-439d-a207-4296d5608192 service placement] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:51.664311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6540157-ea72-439d-a207-4296d5608192 service placement] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:51.718894 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:51.725056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:51.726209 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:51.726498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:51.726779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] PATH_INFO: `/v3/projects/8accbe2ccd0d415fa3f31e3b0f6298db` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:51.727982 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8accbe2ccd0d415fa3f31e3b0f6298db)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:51.730018 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:51.858331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8accbe2ccd0d415fa3f31e3b0f6298db', 'request_id': 'req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.864586 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8accbe2ccd0d415fa3f31e3b0f6298db', 'request_id': 'req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.931287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8accbe2ccd0d415fa3f31e3b0f6298db', 'request_id': 'req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.942559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] The token cache is being invalidate because project 8accbe2ccd0d415fa3f31e3b0f6298db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:57:51.942878 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.943508 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-0ad4ff8b-2b42-4730-ba4c-acd76850ad2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:51.945675 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1428/2823] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:57:51 2022] DELETE /identity/v3/projects/8accbe2ccd0d415fa3f31e3b0f6298db => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:51.952131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5596-c1f2-49de-b986-b8071e7650b6 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:51.952620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5596-c1f2-49de-b986-b8071e7650b6 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:51.952718 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5596-c1f2-49de-b986-b8071e7650b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:51.972076 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-858c5596-c1f2-49de-b986-b8071e7650b6 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:51.973386 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-858c5596-c1f2-49de-b986-b8071e7650b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:51.986115 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:52.032964 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1396/2824] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:52.040872 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096cdf4-1b6f-4f90-a9cd-60661a83549e None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.041173 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096cdf4-1b6f-4f90-a9cd-60661a83549e None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.041464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096cdf4-1b6f-4f90-a9cd-60661a83549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.059966 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-3096cdf4-1b6f-4f90-a9cd-60661a83549e None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:52.061219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-3096cdf4-1b6f-4f90-a9cd-60661a83549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:52.069973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1429/2825] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:52.074122 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5596-c1f2-49de-b986-b8071e7650b6 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:52.084028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5596-c1f2-49de-b986-b8071e7650b6 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:52.089278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24794fb4-4f9b-48db-9411-1f16593eedc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:52.090014 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24794fb4-4f9b-48db-9411-1f16593eedc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.090301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24794fb4-4f9b-48db-9411-1f16593eedc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.090578 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24794fb4-4f9b-48db-9411-1f16593eedc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.091311 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24794fb4-4f9b-48db-9411-1f16593eedc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:52.091620 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24794fb4-4f9b-48db-9411-1f16593eedc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:52.093273 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24794fb4-4f9b-48db-9411-1f16593eedc9 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:52.105717 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1397/2826] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:52.110158 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096cdf4-1b6f-4f90-a9cd-60661a83549e None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:52.120456 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096cdf4-1b6f-4f90-a9cd-60661a83549e None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:52.125157 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562031f0-5ca6-4f86-988d-8947dc99836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:52.125815 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562031f0-5ca6-4f86-988d-8947dc99836f admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.126105 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562031f0-5ca6-4f86-988d-8947dc99836f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.126376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562031f0-5ca6-4f86-988d-8947dc99836f admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.127070 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562031f0-5ca6-4f86-988d-8947dc99836f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:52.129223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562031f0-5ca6-4f86-988d-8947dc99836f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:52.242210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1430/2827] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:57:52 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:52.246352 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24794fb4-4f9b-48db-9411-1f16593eedc9 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:52.257245 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24794fb4-4f9b-48db-9411-1f16593eedc9 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:52.313553 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfdba7-b99d-4f12-944a-7ae1e4f1c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:52.314229 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfdba7-b99d-4f12-944a-7ae1e4f1c548 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.314511 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfdba7-b99d-4f12-944a-7ae1e4f1c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.314787 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfdba7-b99d-4f12-944a-7ae1e4f1c548 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.315481 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfdba7-b99d-4f12-944a-7ae1e4f1c548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:52.317444 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfdba7-b99d-4f12-944a-7ae1e4f1c548 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:52.405443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1398/2828] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:57:52 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:52.409716 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562031f0-5ca6-4f86-988d-8947dc99836f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:52.420839 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562031f0-5ca6-4f86-988d-8947dc99836f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:52.425879 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42c60a-5084-4b4a-a8ab-f4af6a234898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:52.426545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c60a-5084-4b4a-a8ab-f4af6a234898 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.426831 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c60a-5084-4b4a-a8ab-f4af6a234898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.427108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c60a-5084-4b4a-a8ab-f4af6a234898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.427835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42c60a-5084-4b4a-a8ab-f4af6a234898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:52.430255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42c60a-5084-4b4a-a8ab-f4af6a234898 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:52.441193 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1431/2829] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:52.445581 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfdba7-b99d-4f12-944a-7ae1e4f1c548 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:52.455661 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfdba7-b99d-4f12-944a-7ae1e4f1c548 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:52.460506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a98c00-b793-4a8e-8cab-4b0536ac50ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:52.461165 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a98c00-b793-4a8e-8cab-4b0536ac50ee admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.461451 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a98c00-b793-4a8e-8cab-4b0536ac50ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.461727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a98c00-b793-4a8e-8cab-4b0536ac50ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.462443 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a98c00-b793-4a8e-8cab-4b0536ac50ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:52.464042 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a98c00-b793-4a8e-8cab-4b0536ac50ee admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:52.473908 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1399/2830] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:52.480453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42c60a-5084-4b4a-a8ab-f4af6a234898 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:52.490282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42c60a-5084-4b4a-a8ab-f4af6a234898 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:52.502122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7a1d1-4379-4109-9427-d481f0176d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:52.502122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7a1d1-4379-4109-9427-d481f0176d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.502122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7a1d1-4379-4109-9427-d481f0176d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.502122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7a1d1-4379-4109-9427-d481f0176d19 admin admin] PATH_INFO: `/v3/projects/6ae6212e50a1473a91e3abcff84f6f9b/users/43e80a38a048456ba61ce41648475374/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.514671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7a1d1-4379-4109-9427-d481f0176d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae6212e50a1473a91e3abcff84f6f9b, user_id=43e80a38a048456ba61ce41648475374, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:52.517423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7a1d1-4379-4109-9427-d481f0176d19 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:52.640768 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1432/2831] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:57:52 2022] PUT /identity/v3/projects/6ae6212e50a1473a91e3abcff84f6f9b/users/43e80a38a048456ba61ce41648475374/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:52.645778 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff2314-f950-4b78-ae5d-32c0f77c398d None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.646067 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff2314-f950-4b78-ae5d-32c0f77c398d None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.646342 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff2314-f950-4b78-ae5d-32c0f77c398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.665210 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-c6ff2314-f950-4b78-ae5d-32c0f77c398d None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:52.666466 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c6ff2314-f950-4b78-ae5d-32c0f77c398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:52.726606 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1400/2832] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:57:52.736176 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7a1d1-4379-4109-9427-d481f0176d19 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:52.737858 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-7cc7a1d1-4379-4109-9427-d481f0176d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:52.778627 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff2314-f950-4b78-ae5d-32c0f77c398d None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:52.780134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-c6ff2314-f950-4b78-ae5d-32c0f77c398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:52.792868 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff2314-f950-4b78-ae5d-32c0f77c398d None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:52.797054 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7a1d1-4379-4109-9427-d481f0176d19 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:52.797539 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:52.798410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.798702 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.798981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] PATH_INFO: `/v3/users/a0f63c7ed531446786ad9d01d941d991` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.800181 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f63c7ed531446786ad9d01d941d991)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:52.800897 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e632f-5737-488e-b043-ee090bbb5513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:52.801533 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e632f-5737-488e-b043-ee090bbb5513 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:52.801820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e632f-5737-488e-b043-ee090bbb5513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:52.802096 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e632f-5737-488e-b043-ee090bbb5513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:52.802215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:52.812555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e632f-5737-488e-b043-ee090bbb5513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:52.813990 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e632f-5737-488e-b043-ee090bbb5513 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:52.824380 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1433/2833] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:52.826549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:53.021841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f63c7ed531446786ad9d01d941d991'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.023096 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f63c7ed531446786ad9d01d941d991'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.030333 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f63c7ed531446786ad9d01d941d991'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.042767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f63c7ed531446786ad9d01d941d991'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.114789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f63c7ed531446786ad9d01d941d991'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.125879 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1401/2834] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:57:52 2022] DELETE /identity/v3/users/a0f63c7ed531446786ad9d01d941d991 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:57:53.127846 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c54a8-8303-4490-837a-d5ba55dce465 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:53.128223 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c54a8-8303-4490-837a-d5ba55dce465 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:53.128426 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c54a8-8303-4490-837a-d5ba55dce465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:53.146863 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-ae8c54a8-8303-4490-837a-d5ba55dce465 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:53.148093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ae8c54a8-8303-4490-837a-d5ba55dce465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:53.171646 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:53.213249 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1434/2835] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:53.222566 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:53.224072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:53.281560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc2f9-b64c-412b-abc8-3b626f9e5ac3 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:53.285117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e90277-00b0-48a4-9dd1-48babd0230c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:53.285798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e90277-00b0-48a4-9dd1-48babd0230c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:53.286083 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e90277-00b0-48a4-9dd1-48babd0230c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:53.286361 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e90277-00b0-48a4-9dd1-48babd0230c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:53.296490 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e90277-00b0-48a4-9dd1-48babd0230c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:53.297965 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e90277-00b0-48a4-9dd1-48babd0230c2 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:53.308398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1402/2836] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:53.762443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c54a8-8303-4490-837a-d5ba55dce465 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:53.763981 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ae8c54a8-8303-4490-837a-d5ba55dce465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:53.778752 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c54a8-8303-4490-837a-d5ba55dce465 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:53.784111 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:53.785062 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:53.785399 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:53.785683 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] PATH_INFO: `/v3/projects/7a9730ee93674e42a43bdb1c9ff50354` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:53.787161 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9730ee93674e42a43bdb1c9ff50354)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:53.789733 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:53.908855 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9730ee93674e42a43bdb1c9ff50354', 'request_id': 'req-f9e1c949-e429-4f37-9442-43f352385fef'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.914460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9730ee93674e42a43bdb1c9ff50354', 'request_id': 'req-f9e1c949-e429-4f37-9442-43f352385fef'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.982965 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9730ee93674e42a43bdb1c9ff50354', 'request_id': 'req-f9e1c949-e429-4f37-9442-43f352385fef'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.997061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] The token cache is being invalidate because project 7a9730ee93674e42a43bdb1c9ff50354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:57:53.997352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.998000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f9e1c949-e429-4f37-9442-43f352385fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:57:53.999888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1435/2837] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:57:53 2022] DELETE /identity/v3/projects/7a9730ee93674e42a43bdb1c9ff50354 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:54.004646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01930216-f86c-44d6-bc6f-c4b3aa695c38 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.004940 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01930216-f86c-44d6-bc6f-c4b3aa695c38 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.005217 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01930216-f86c-44d6-bc6f-c4b3aa695c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.023235 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-01930216-f86c-44d6-bc6f-c4b3aa695c38 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:54.025099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-01930216-f86c-44d6-bc6f-c4b3aa695c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:54.097767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1403/2838] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:54.107559 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ec195-00a6-40ee-b471-632c4a696552 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.107888 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ec195-00a6-40ee-b471-632c4a696552 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.108172 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ec195-00a6-40ee-b471-632c4a696552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.127352 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-694ec195-00a6-40ee-b471-632c4a696552 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:54.128637 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-694ec195-00a6-40ee-b471-632c4a696552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:54.137668 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1436/2839] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:57:54.141774 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01930216-f86c-44d6-bc6f-c4b3aa695c38 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:54.152836 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01930216-f86c-44d6-bc6f-c4b3aa695c38 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:54.157765 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0c574-bbd9-45b5-afb8-d2d45ad4dff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:54.158571 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0c574-bbd9-45b5-afb8-d2d45ad4dff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.158861 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0c574-bbd9-45b5-afb8-d2d45ad4dff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.159170 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0c574-bbd9-45b5-afb8-d2d45ad4dff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.159909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0c574-bbd9-45b5-afb8-d2d45ad4dff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:57:54.160222 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0c574-bbd9-45b5-afb8-d2d45ad4dff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:54.161916 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0c574-bbd9-45b5-afb8-d2d45ad4dff5 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:54.180354 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1404/2840] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:57:54.186777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ec195-00a6-40ee-b471-632c4a696552 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:54.197344 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ec195-00a6-40ee-b471-632c4a696552 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:54.203032 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182620a-59fe-4f27-9ab9-4126bcbd128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:54.203709 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182620a-59fe-4f27-9ab9-4126bcbd128d admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.203998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182620a-59fe-4f27-9ab9-4126bcbd128d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.204339 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182620a-59fe-4f27-9ab9-4126bcbd128d admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.205037 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182620a-59fe-4f27-9ab9-4126bcbd128d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:54.207266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182620a-59fe-4f27-9ab9-4126bcbd128d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:54.346515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1437/2841] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:57:54 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:54.352209 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0c574-bbd9-45b5-afb8-d2d45ad4dff5 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:54.363224 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0c574-bbd9-45b5-afb8-d2d45ad4dff5 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:54.393655 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:54.426455 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62795a3b-1509-402f-a4b6-5b9a5c06a2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:54.427200 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62795a3b-1509-402f-a4b6-5b9a5c06a2ac admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.427412 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62795a3b-1509-402f-a4b6-5b9a5c06a2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.427690 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62795a3b-1509-402f-a4b6-5b9a5c06a2ac admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.429028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62795a3b-1509-402f-a4b6-5b9a5c06a2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:54.430768 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62795a3b-1509-402f-a4b6-5b9a5c06a2ac admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:54.527862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1405/2842] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:57:54 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:57:54.532011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182620a-59fe-4f27-9ab9-4126bcbd128d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:54.544630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182620a-59fe-4f27-9ab9-4126bcbd128d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:54.549538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee6ec2-a2a4-4804-a0c7-0e287e39dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:54.550230 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6ec2-a2a4-4804-a0c7-0e287e39dd3d admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.550512 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6ec2-a2a4-4804-a0c7-0e287e39dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.550786 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6ec2-a2a4-4804-a0c7-0e287e39dd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.551527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee6ec2-a2a4-4804-a0c7-0e287e39dd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:54.553215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee6ec2-a2a4-4804-a0c7-0e287e39dd3d admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:54.570039 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1438/2843] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:57:54.570789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62795a3b-1509-402f-a4b6-5b9a5c06a2ac admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:54.582162 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62795a3b-1509-402f-a4b6-5b9a5c06a2ac admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:54.590151 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554093d-4ddb-48a0-95b1-37d61d192909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:54.590749 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554093d-4ddb-48a0-95b1-37d61d192909 admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.591032 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554093d-4ddb-48a0-95b1-37d61d192909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.591529 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554093d-4ddb-48a0-95b1-37d61d192909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.592098 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554093d-4ddb-48a0-95b1-37d61d192909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:54.594477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554093d-4ddb-48a0-95b1-37d61d192909 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:54.606818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1406/2844] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:57:54.611538 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee6ec2-a2a4-4804-a0c7-0e287e39dd3d admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:54.623852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee6ec2-a2a4-4804-a0c7-0e287e39dd3d admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:54.629994 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6281b-e76e-4b27-9a66-a38f37b11a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:54.632355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6281b-e76e-4b27-9a66-a38f37b11a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.632355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6281b-e76e-4b27-9a66-a38f37b11a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.632355 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6281b-e76e-4b27-9a66-a38f37b11a48 admin admin] PATH_INFO: `/v3/projects/76512cf5f51b4bc9a4a4f2bb75cc413b/users/2c1462f97e2c45559a1592efcc0457ab/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.652525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6281b-e76e-4b27-9a66-a38f37b11a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76512cf5f51b4bc9a4a4f2bb75cc413b, user_id=2c1462f97e2c45559a1592efcc0457ab, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:54.655536 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6281b-e76e-4b27-9a66-a38f37b11a48 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:54.748617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1439/2845] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:57:54 2022] PUT /identity/v3/projects/76512cf5f51b4bc9a4a4f2bb75cc413b/users/2c1462f97e2c45559a1592efcc0457ab/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:57:54.759667 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd44a96-da5a-4266-ba49-8f2b61384954 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.759956 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd44a96-da5a-4266-ba49-8f2b61384954 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.760258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd44a96-da5a-4266-ba49-8f2b61384954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.793213 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0dd44a96-da5a-4266-ba49-8f2b61384954 None None] MFA Rules not processed for user `2c1462f97e2c45559a1592efcc0457ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:54.794564 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0dd44a96-da5a-4266-ba49-8f2b61384954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:54.881482 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1407/2846] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:54.895434 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6281b-e76e-4b27-9a66-a38f37b11a48 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:54.898127 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-47c6281b-e76e-4b27-9a66-a38f37b11a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:54.965587 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:54.970074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6281b-e76e-4b27-9a66-a38f37b11a48 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:54.974093 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aba73-989f-4cb7-98ed-e8711fcff5b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:54.974843 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aba73-989f-4cb7-98ed-e8711fcff5b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:54.975221 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aba73-989f-4cb7-98ed-e8711fcff5b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:54.975537 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aba73-989f-4cb7-98ed-e8711fcff5b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:54.985563 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aba73-989f-4cb7-98ed-e8711fcff5b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:54.987056 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aba73-989f-4cb7-98ed-e8711fcff5b3 service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:54.998896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1440/2847] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:57:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:57:56.860435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987b257-ab6d-4710-a66e-ec2c7f055d0a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:56.860922 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987b257-ab6d-4710-a66e-ec2c7f055d0a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:56.861056 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987b257-ab6d-4710-a66e-ec2c7f055d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:56.880504 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-2987b257-ab6d-4710-a66e-ec2c7f055d0a None None] MFA Rules not processed for user `2c1462f97e2c45559a1592efcc0457ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:56.882100 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-2987b257-ab6d-4710-a66e-ec2c7f055d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:56.893605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1408/2848] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:58.717694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73d81-ad77-4325-860b-fa6548d65110 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:58.717694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73d81-ad77-4325-860b-fa6548d65110 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:58.717694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73d81-ad77-4325-860b-fa6548d65110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:58.749624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-6cb73d81-ad77-4325-860b-fa6548d65110 None None] MFA Rules not processed for user `2aa01ac54736475188dbc47f3cda4de1`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:58.749624 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6cb73d81-ad77-4325-860b-fa6548d65110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:58.849252 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1441/2849] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:59.502304 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116e39-f243-4e31-8c3a-820a0ca8abeb None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:59.502871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116e39-f243-4e31-8c3a-820a0ca8abeb None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:59.502871 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116e39-f243-4e31-8c3a-820a0ca8abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:59.538527 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-ed116e39-f243-4e31-8c3a-820a0ca8abeb None None] MFA Rules not processed for user `43e80a38a048456ba61ce41648475374`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:57:59.540874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ed116e39-f243-4e31-8c3a-820a0ca8abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:59.626947 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1409/2850] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:57:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:57:59.631247 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb73d81-ad77-4325-860b-fa6548d65110 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:59.632883 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-6cb73d81-ad77-4325-860b-fa6548d65110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:57:59.714028 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb73d81-ad77-4325-860b-fa6548d65110 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:59.718699 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad713df-8eb9-4e9c-b014-fc0635e7da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:59.719759 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad713df-8eb9-4e9c-b014-fc0635e7da12 admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:59.722166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad713df-8eb9-4e9c-b014-fc0635e7da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:59.722166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad713df-8eb9-4e9c-b014-fc0635e7da12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:59.722166 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad713df-8eb9-4e9c-b014-fc0635e7da12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:59.723386 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad713df-8eb9-4e9c-b014-fc0635e7da12 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:57:59.816860 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1442/2851] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:57:59 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:57:59.821285 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed116e39-f243-4e31-8c3a-820a0ca8abeb None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:57:59.833975 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed116e39-f243-4e31-8c3a-820a0ca8abeb None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:57:59.859025 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:59.933958 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b89f4a-1626-41c9-87ce-cfd2dea37bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:57:59.934663 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b89f4a-1626-41c9-87ce-cfd2dea37bec admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:57:59.934951 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b89f4a-1626-41c9-87ce-cfd2dea37bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:57:59.935258 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b89f4a-1626-41c9-87ce-cfd2dea37bec admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:57:59.936044 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b89f4a-1626-41c9-87ce-cfd2dea37bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:57:59.938144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b89f4a-1626-41c9-87ce-cfd2dea37bec admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:00.075609 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1410/2852] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:57:59 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:58:00.079545 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad713df-8eb9-4e9c-b014-fc0635e7da12 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:00.090907 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad713df-8eb9-4e9c-b014-fc0635e7da12 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:00.095560 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a8dd-2d51-4744-8869-98cf2986390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:00.096265 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a8dd-2d51-4744-8869-98cf2986390f admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:00.097334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a8dd-2d51-4744-8869-98cf2986390f admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:00.097334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a8dd-2d51-4744-8869-98cf2986390f admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:00.097649 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00a8dd-2d51-4744-8869-98cf2986390f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:00.099305 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00a8dd-2d51-4744-8869-98cf2986390f admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:00.110769 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1443/2853] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:58:00.115401 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b89f4a-1626-41c9-87ce-cfd2dea37bec admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:00.127230 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b89f4a-1626-41c9-87ce-cfd2dea37bec admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:00.134770 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a08a6-744c-4c90-bf84-93e346fa899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:00.136873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a08a6-744c-4c90-bf84-93e346fa899a admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:00.136873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a08a6-744c-4c90-bf84-93e346fa899a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:00.136873 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a08a6-744c-4c90-bf84-93e346fa899a admin admin] PATH_INFO: `/v3/projects/8147630404c14b24a620ff1ec387ba52/users/0399bcccea2541cd8bd13584b371e7c1/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:00.155199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a08a6-744c-4c90-bf84-93e346fa899a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8147630404c14b24a620ff1ec387ba52, user_id=0399bcccea2541cd8bd13584b371e7c1, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:00.157952 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a08a6-744c-4c90-bf84-93e346fa899a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:00.231494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1411/2854] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:58:00 2022] PUT /identity/v3/projects/8147630404c14b24a620ff1ec387ba52/users/0399bcccea2541cd8bd13584b371e7c1/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:58:00.235719 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a8dd-2d51-4744-8869-98cf2986390f admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:00.247389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a8dd-2d51-4744-8869-98cf2986390f admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:00.311778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf80f2-32e9-4c12-9def-f43c21a30e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:00.312679 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf80f2-32e9-4c12-9def-f43c21a30e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:00.312968 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf80f2-32e9-4c12-9def-f43c21a30e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:00.313246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf80f2-32e9-4c12-9def-f43c21a30e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:00.314008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf80f2-32e9-4c12-9def-f43c21a30e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:00.315627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf80f2-32e9-4c12-9def-f43c21a30e53 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:00.327205 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1444/2855] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:58:00.331758 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a08a6-744c-4c90-bf84-93e346fa899a admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:00.343475 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a08a6-744c-4c90-bf84-93e346fa899a admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:00.350968 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52231c5-b4ae-4877-a60a-c3baa56e4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:00.351969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52231c5-b4ae-4877-a60a-c3baa56e4bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:00.352259 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52231c5-b4ae-4877-a60a-c3baa56e4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:00.353060 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52231c5-b4ae-4877-a60a-c3baa56e4bee admin admin] PATH_INFO: `/v3/projects/8147630404c14b24a620ff1ec387ba52/users/0399bcccea2541cd8bd13584b371e7c1/roles/9940743bd8ed4e5cbb8918cc70c893ad` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:00.354789 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52231c5-b4ae-4877-a60a-c3baa56e4bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8147630404c14b24a620ff1ec387ba52, user_id=0399bcccea2541cd8bd13584b371e7c1, role_id=9940743bd8ed4e5cbb8918cc70c893ad)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:00.371674 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52231c5-b4ae-4877-a60a-c3baa56e4bee admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:00.391450 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1412/2856] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:58:00 2022] PUT /identity/v3/projects/8147630404c14b24a620ff1ec387ba52/users/0399bcccea2541cd8bd13584b371e7c1/roles/9940743bd8ed4e5cbb8918cc70c893ad => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:58:07.938740 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac4910-16c5-41d6-b0b4-bc688d4fb954 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:07.940948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac4910-16c5-41d6-b0b4-bc688d4fb954 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:07.940948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac4910-16c5-41d6-b0b4-bc688d4fb954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:07.980957 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:08.016546 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-27ac4910-16c5-41d6-b0b4-bc688d4fb954 None None] MFA Rules not processed for user `0399bcccea2541cd8bd13584b371e7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:08.017773 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-27ac4910-16c5-41d6-b0b4-bc688d4fb954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:08.106329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1445/2857] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:58:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:08.119993 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52231c5-b4ae-4877-a60a-c3baa56e4bee admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:08.125898 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b52231c5-b4ae-4877-a60a-c3baa56e4bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:08.230071 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52231c5-b4ae-4877-a60a-c3baa56e4bee admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:08.235949 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce03ead-3266-4f93-affb-9324b0540bef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:08.236662 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03ead-3266-4f93-affb-9324b0540bef service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:08.236948 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03ead-3266-4f93-affb-9324b0540bef service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:08.237580 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03ead-3266-4f93-affb-9324b0540bef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:08.302448 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03ead-3266-4f93-affb-9324b0540bef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:08.305062 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03ead-3266-4f93-affb-9324b0540bef service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:08.315847 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1413/2858] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:58:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:58:10.893555 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ddf44-ca5c-4a25-bca5-8452ee46b620 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:10.894061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ddf44-ca5c-4a25-bca5-8452ee46b620 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:10.894179 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ddf44-ca5c-4a25-bca5-8452ee46b620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:10.912383 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-5b3ddf44-ca5c-4a25-bca5-8452ee46b620 None None] MFA Rules not processed for user `43e80a38a048456ba61ce41648475374`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:10.914185 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5b3ddf44-ca5c-4a25-bca5-8452ee46b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:10.921258 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1446/2859] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:58:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:17.751215 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9d99-34cb-42f0-a39f-3da721c1e050 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:17.751673 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9d99-34cb-42f0-a39f-3da721c1e050 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:17.751792 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9d99-34cb-42f0-a39f-3da721c1e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:17.771050 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-b8ae9d99-34cb-42f0-a39f-3da721c1e050 None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:17.772339 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-b8ae9d99-34cb-42f0-a39f-3da721c1e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:17.776850 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:17.831803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1414/2860] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:17.844418 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ddf44-ca5c-4a25-bca5-8452ee46b620 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:17.849391 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-5b3ddf44-ca5c-4a25-bca5-8452ee46b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:17.917443 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ddf44-ca5c-4a25-bca5-8452ee46b620 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:17.922398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dc356-4668-4a2c-bcb5-bc209b04e0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:17.923048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dc356-4668-4a2c-bcb5-bc209b04e0e9 service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:17.923335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dc356-4668-4a2c-bcb5-bc209b04e0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:17.923619 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dc356-4668-4a2c-bcb5-bc209b04e0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:17.933145 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dc356-4668-4a2c-bcb5-bc209b04e0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:17.934744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dc356-4668-4a2c-bcb5-bc209b04e0e9 service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:17.942730 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1447/2861] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:58:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:58:18.895289 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def18684-eb92-4a8a-944d-ece4f64993d7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:18.895811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def18684-eb92-4a8a-944d-ece4f64993d7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:18.896079 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def18684-eb92-4a8a-944d-ece4f64993d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:18.916854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-def18684-eb92-4a8a-944d-ece4f64993d7 None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:18.918126 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-def18684-eb92-4a8a-944d-ece4f64993d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:18.925706 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1415/2862] 10.222.0.74 () {58 vars in 967 bytes} [Mon May 23 16:58:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:58:18.941584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dc356-4668-4a2c-bcb5-bc209b04e0e9 service swift] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:18.953041 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dc356-4668-4a2c-bcb5-bc209b04e0e9 service swift] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:18.958928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159667ce-44a1-477e-a8e1-9b310f95b4ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:18.959810 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159667ce-44a1-477e-a8e1-9b310f95b4ea service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:18.960099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159667ce-44a1-477e-a8e1-9b310f95b4ea service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:18.960450 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159667ce-44a1-477e-a8e1-9b310f95b4ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:18.970207 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159667ce-44a1-477e-a8e1-9b310f95b4ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:18.971935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159667ce-44a1-477e-a8e1-9b310f95b4ea service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:18.981700 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1448/2863] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:58:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:58:19.577180 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de81345-bcac-4949-9ef8-76ca30d6b9e7 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:19.577491 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de81345-bcac-4949-9ef8-76ca30d6b9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:19.577798 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de81345-bcac-4949-9ef8-76ca30d6b9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:19.596899 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-3de81345-bcac-4949-9ef8-76ca30d6b9e7 None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:19.598104 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-3de81345-bcac-4949-9ef8-76ca30d6b9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:19.605840 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1416/2864] 10.222.0.74 () {58 vars in 1009 bytes} [Mon May 23 16:58:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:19.617694 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159667ce-44a1-477e-a8e1-9b310f95b4ea service swift] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:19.628687 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159667ce-44a1-477e-a8e1-9b310f95b4ea service swift] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:19.634376 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da3989-d83b-466d-ac95-c9a695926056 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:19.635040 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da3989-d83b-466d-ac95-c9a695926056 service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:19.635324 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da3989-d83b-466d-ac95-c9a695926056 service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:19.635597 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da3989-d83b-466d-ac95-c9a695926056 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:19.643728 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da3989-d83b-466d-ac95-c9a695926056 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:19.645461 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da3989-d83b-466d-ac95-c9a695926056 service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:19.655789 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1449/2865] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:58:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:58:20.217811 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80869-ea40-4130-9cec-21f18e92eaef None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:20.218317 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80869-ea40-4130-9cec-21f18e92eaef None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:20.218694 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80869-ea40-4130-9cec-21f18e92eaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:20.238809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-d6f80869-ea40-4130-9cec-21f18e92eaef None None] MFA Rules not processed for user `d673b38649fe44059ae0257df02ed61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:20.240006 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-d6f80869-ea40-4130-9cec-21f18e92eaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:20.247837 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1417/2866] 10.222.0.74 () {58 vars in 967 bytes} [Mon May 23 16:58:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:20.259807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da3989-d83b-466d-ac95-c9a695926056 service swift] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:20.270551 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da3989-d83b-466d-ac95-c9a695926056 service swift] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:20.276239 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9cce-25f0-4f24-a37c-c949e561ebb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45f676694ec24de2a5c755e217baed87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:20.277007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9cce-25f0-4f24-a37c-c949e561ebb4 service swift] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:20.277389 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9cce-25f0-4f24-a37c-c949e561ebb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:20.277676 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9cce-25f0-4f24-a37c-c949e561ebb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:20.287042 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee9cce-25f0-4f24-a37c-c949e561ebb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:20.288697 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee9cce-25f0-4f24-a37c-c949e561ebb4 service swift] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:20.297893 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1450/2867] 10.222.0.74 () {60 vars in 1384 bytes} [Mon May 23 16:58:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:58:23.061413 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80869-ea40-4130-9cec-21f18e92eaef None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:23.126410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80869-ea40-4130-9cec-21f18e92eaef None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:23.131262 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:23.132131 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:23.132456 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:23.132733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] PATH_INFO: `/v3/users/2c1462f97e2c45559a1592efcc0457ab` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:23.134942 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1462f97e2c45559a1592efcc0457ab)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:23.136924 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:23.300256 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1462f97e2c45559a1592efcc0457ab'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:23.300946 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1462f97e2c45559a1592efcc0457ab'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:23.309643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1462f97e2c45559a1592efcc0457ab'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:23.322937 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1462f97e2c45559a1592efcc0457ab'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:23.371297 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1462f97e2c45559a1592efcc0457ab'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:23.381560 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1418/2868] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 16:58:23 2022] DELETE /identity/v3/users/2c1462f97e2c45559a1592efcc0457ab => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:58:23.383276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239f0d-97e4-4d0b-b951-9f4ffb8a7c4b None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:23.383996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239f0d-97e4-4d0b-b951-9f4ffb8a7c4b None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:23.383996 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239f0d-97e4-4d0b-b951-9f4ffb8a7c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:23.410821 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-d7239f0d-97e4-4d0b-b951-9f4ffb8a7c4b None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:23.412045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d7239f0d-97e4-4d0b-b951-9f4ffb8a7c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:23.442961 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=100 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:23.474381 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1451/2869] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:23.485601 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:23.487114 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:23.502260 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:23.547813 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8495796-0d6a-4554-b319-cd0cc1a6c83b admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:23.551550 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d4afe-a0f3-4210-9c20-c7dcfb221e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:23.552202 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d4afe-a0f3-4210-9c20-c7dcfb221e55 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:23.552519 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d4afe-a0f3-4210-9c20-c7dcfb221e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:23.552793 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d4afe-a0f3-4210-9c20-c7dcfb221e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:23.562699 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d4afe-a0f3-4210-9c20-c7dcfb221e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:23.564931 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d4afe-a0f3-4210-9c20-c7dcfb221e55 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:23.573883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1419/2870] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:58:23.830630 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7239f0d-97e4-4d0b-b951-9f4ffb8a7c4b None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:23.832335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-d7239f0d-97e4-4d0b-b951-9f4ffb8a7c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:23.853577 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7239f0d-97e4-4d0b-b951-9f4ffb8a7c4b None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:23.859896 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:23.863892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:23.863892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:23.863892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] PATH_INFO: `/v3/projects/76512cf5f51b4bc9a4a4f2bb75cc413b` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:23.863892 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76512cf5f51b4bc9a4a4f2bb75cc413b)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:23.865058 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:23.983989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'request_id': 'req-079521f6-cdcd-40d6-8456-3814986844a9'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:23.989584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'request_id': 'req-079521f6-cdcd-40d6-8456-3814986844a9'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:24.106527 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'request_id': 'req-079521f6-cdcd-40d6-8456-3814986844a9'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:24.118617 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] The token cache is being invalidate because project 76512cf5f51b4bc9a4a4f2bb75cc413b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:58:24.119019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:24.121206 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-079521f6-cdcd-40d6-8456-3814986844a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:58:24.121535 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1452/2871] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 16:58:23 2022] DELETE /identity/v3/projects/76512cf5f51b4bc9a4a4f2bb75cc413b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:58:24.126477 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4f3c-8d6f-4171-b935-f5e2024a210a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.126990 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4f3c-8d6f-4171-b935-f5e2024a210a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.127094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4f3c-8d6f-4171-b935-f5e2024a210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:24.178302 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-547a4f3c-8d6f-4171-b935-f5e2024a210a None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:24.179555 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-547a4f3c-8d6f-4171-b935-f5e2024a210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:24.246943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1420/2872] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:24.254462 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462864d-0411-4423-a6f9-442d106fd224 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.254755 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462864d-0411-4423-a6f9-442d106fd224 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.255034 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462864d-0411-4423-a6f9-442d106fd224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:24.274022 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-8462864d-0411-4423-a6f9-442d106fd224 None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:24.275286 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8462864d-0411-4423-a6f9-442d106fd224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:24.283180 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1453/2873] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:24.287340 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4f3c-8d6f-4171-b935-f5e2024a210a None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:24.297129 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4f3c-8d6f-4171-b935-f5e2024a210a None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:24.301981 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb75cc-30fb-42be-bc76-61ed5df92a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:24.302651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb75cc-30fb-42be-bc76-61ed5df92a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.309019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb75cc-30fb-42be-bc76-61ed5df92a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.309019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb75cc-30fb-42be-bc76-61ed5df92a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:24.309019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb75cc-30fb-42be-bc76-61ed5df92a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:58:24.309019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb75cc-30fb-42be-bc76-61ed5df92a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:24.309019 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb75cc-30fb-42be-bc76-61ed5df92a9c admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:24.323223 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1421/2874] 10.222.0.74 () {58 vars in 1152 bytes} [Mon May 23 16:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:58:24.324282 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462864d-0411-4423-a6f9-442d106fd224 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:24.333859 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462864d-0411-4423-a6f9-442d106fd224 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:24.339829 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8428-cd97-491c-b4cf-b43ee381e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:24.340515 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8428-cd97-491c-b4cf-b43ee381e24a admin admin] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.340803 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8428-cd97-491c-b4cf-b43ee381e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.341083 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8428-cd97-491c-b4cf-b43ee381e24a admin admin] PATH_INFO: `/v3/projects` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:24.341809 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8428-cd97-491c-b4cf-b43ee381e24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:24.343738 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8428-cd97-491c-b4cf-b43ee381e24a admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:24.438717 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1454/2875] 10.222.0.74 () {60 vars in 1152 bytes} [Mon May 23 16:58:24 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:58:24.440201 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb75cc-30fb-42be-bc76-61ed5df92a9c admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:24.453542 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb75cc-30fb-42be-bc76-61ed5df92a9c admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:24.514058 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb666012-f090-4aa2-b81e-de890414c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:24.514727 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb666012-f090-4aa2-b81e-de890414c283 admin admin] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.515012 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb666012-f090-4aa2-b81e-de890414c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.515284 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb666012-f090-4aa2-b81e-de890414c283 admin admin] PATH_INFO: `/v3/users` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:24.515966 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb666012-f090-4aa2-b81e-de890414c283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:24.517914 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb666012-f090-4aa2-b81e-de890414c283 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:24.593422 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1422/2876] 10.222.0.74 () {60 vars in 1143 bytes} [Mon May 23 16:58:24 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:58:24.597478 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8428-cd97-491c-b4cf-b43ee381e24a admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:24.609124 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8428-cd97-491c-b4cf-b43ee381e24a admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:24.614122 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1624-f9c7-4a15-9bfd-32a6b1a422f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:24.614884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1624-f9c7-4a15-9bfd-32a6b1a422f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.615250 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1624-f9c7-4a15-9bfd-32a6b1a422f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.615995 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1624-f9c7-4a15-9bfd-32a6b1a422f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:24.616565 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1624-f9c7-4a15-9bfd-32a6b1a422f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:24.618276 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1624-f9c7-4a15-9bfd-32a6b1a422f7 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:24.632004 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1455/2877] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:58:24.633195 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb666012-f090-4aa2-b81e-de890414c283 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:24.644858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb666012-f090-4aa2-b81e-de890414c283 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:24.650643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a6b04-ded1-4971-ac63-92e4e81b985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:24.651485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6b04-ded1-4971-ac63-92e4e81b985a admin admin] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.651869 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6b04-ded1-4971-ac63-92e4e81b985a admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.652248 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6b04-ded1-4971-ac63-92e4e81b985a admin admin] PATH_INFO: `/v3/roles` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:24.653110 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a6b04-ded1-4971-ac63-92e4e81b985a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:24.655532 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a6b04-ded1-4971-ac63-92e4e81b985a admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:24.658701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:24.667893 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1423/2878] 10.222.0.74 () {58 vars in 1121 bytes} [Mon May 23 16:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:58:24.672287 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1624-f9c7-4a15-9bfd-32a6b1a422f7 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:24.685972 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1624-f9c7-4a15-9bfd-32a6b1a422f7 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:24.691020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ef072-6d58-40ac-ad6e-ca74c9b96b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:24.691933 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ef072-6d58-40ac-ad6e-ca74c9b96b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.692219 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ef072-6d58-40ac-ad6e-ca74c9b96b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.692520 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ef072-6d58-40ac-ad6e-ca74c9b96b43 admin admin] PATH_INFO: `/v3/projects/bc5eb587a333468a9ae2107de4e9831a/users/a2d904021dea4643b0f4420e33d4dbf9/roles/6b4e2fa093c2483a91793d5ad27bc6e8` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:24.709767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ef072-6d58-40ac-ad6e-ca74c9b96b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5eb587a333468a9ae2107de4e9831a, user_id=a2d904021dea4643b0f4420e33d4dbf9, role_id=6b4e2fa093c2483a91793d5ad27bc6e8)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:24.712714 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ef072-6d58-40ac-ad6e-ca74c9b96b43 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:24.807273 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1456/2879] 10.222.0.74 () {60 vars in 1482 bytes} [Mon May 23 16:58:24 2022] PUT /identity/v3/projects/bc5eb587a333468a9ae2107de4e9831a/users/a2d904021dea4643b0f4420e33d4dbf9/roles/6b4e2fa093c2483a91793d5ad27bc6e8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:58:24.812651 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ae4d-bf70-46f7-b107-9a3775e4b75c None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.813179 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ae4d-bf70-46f7-b107-9a3775e4b75c None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.813612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ae4d-bf70-46f7-b107-9a3775e4b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:24.832722 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-0194ae4d-bf70-46f7-b107-9a3775e4b75c None None] MFA Rules not processed for user `9f0fe22fa44447e8acda5720d7e2ffa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:24.834001 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0194ae4d-bf70-46f7-b107-9a3775e4b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:24.910779 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1424/2880] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:24.918266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ef072-6d58-40ac-ad6e-ca74c9b96b43 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:24.922045 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-bc6ef072-6d58-40ac-ad6e-ca74c9b96b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:24.985468 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ef072-6d58-40ac-ad6e-ca74c9b96b43 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:24.995225 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da7e5d-3d0f-45c2-b898-e9bec85d1a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:24.996138 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da7e5d-3d0f-45c2-b898-e9bec85d1a2e service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:24.996460 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da7e5d-3d0f-45c2-b898-e9bec85d1a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:24.996743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da7e5d-3d0f-45c2-b898-e9bec85d1a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:25.005020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:25.007519 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da7e5d-3d0f-45c2-b898-e9bec85d1a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:25.009144 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da7e5d-3d0f-45c2-b898-e9bec85d1a2e service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:25.024682 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1457/2881] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:58:26.365669 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6fe6d-4fd6-4f38-916e-f0ebe4c8d32a None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:26.366500 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6fe6d-4fd6-4f38-916e-f0ebe4c8d32a None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:26.366780 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6fe6d-4fd6-4f38-916e-f0ebe4c8d32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:26.396017 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-acd6fe6d-4fd6-4f38-916e-f0ebe4c8d32a None None] MFA Rules not processed for user `a2d904021dea4643b0f4420e33d4dbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:26.397323 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-acd6fe6d-4fd6-4f38-916e-f0ebe4c8d32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:26.465695 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1425/2882] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:58:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:26.476774 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da7e5d-3d0f-45c2-b898-e9bec85d1a2e service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:26.478326 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-22da7e5d-3d0f-45c2-b898-e9bec85d1a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:26.557340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da7e5d-3d0f-45c2-b898-e9bec85d1a2e service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:26.561000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16694c9a-3faa-4fea-8574-ff4a43583cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:26.561647 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16694c9a-3faa-4fea-8574-ff4a43583cfb service cinder] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:26.561928 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16694c9a-3faa-4fea-8574-ff4a43583cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:26.562261 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16694c9a-3faa-4fea-8574-ff4a43583cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:26.575080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16694c9a-3faa-4fea-8574-ff4a43583cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:26.575080 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16694c9a-3faa-4fea-8574-ff4a43583cfb service cinder] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:26.581912 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1458/2883] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:58:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:58:29.389955 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd429523-64f1-4af1-aa27-f13a389e5de2 None None] REQUEST_METHOD: `POST` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:29.390472 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd429523-64f1-4af1-aa27-f13a389e5de2 None None] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:29.390574 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd429523-64f1-4af1-aa27-f13a389e5de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:29.408943 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.auth.core [None req-dd429523-64f1-4af1-aa27-f13a389e5de2 None None] MFA Rules not processed for user `a2d904021dea4643b0f4420e33d4dbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:58:29.410147 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-dd429523-64f1-4af1-aa27-f13a389e5de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:29.417199 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1426/2884] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:58:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:58:29.651255 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16694c9a-3faa-4fea-8574-ff4a43583cfb service cinder] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:29.652698 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-16694c9a-3faa-4fea-8574-ff4a43583cfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:29.664715 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16694c9a-3faa-4fea-8574-ff4a43583cfb service cinder] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:29.668368 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36ae7c-6306-4df5-b1e8-7afcdaf9e3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:29.669009 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36ae7c-6306-4df5-b1e8-7afcdaf9e3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:29.669291 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36ae7c-6306-4df5-b1e8-7afcdaf9e3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:29.669566 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36ae7c-6306-4df5-b1e8-7afcdaf9e3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:29.671334 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8c36ae7c-6306-4df5-b1e8-7afcdaf9e3a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:29.681599 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36ae7c-6306-4df5-b1e8-7afcdaf9e3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:29.683050 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36ae7c-6306-4df5-b1e8-7afcdaf9e3a0 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:29.691744 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1459/2885] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:58:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:58:38.600106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd429523-64f1-4af1-aa27-f13a389e5de2 None None] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:38.604599 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-dd429523-64f1-4af1-aa27-f13a389e5de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:38.716818 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd429523-64f1-4af1-aa27-f13a389e5de2 None None] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:38.723288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:38.724106 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:38.724435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:38.724707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:38.726723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:38.741549 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:38.748928 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:38.763782 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1427/2886] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:58:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:58:39.688094 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=43 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:48.756512 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=97 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:51.928059 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36ae7c-6306-4df5-b1e8-7afcdaf9e3a0 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:58:51.937510 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36ae7c-6306-4df5-b1e8-7afcdaf9e3a0 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:58:51.941195 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d15a3-7d43-4ee6-bbfe-b1c5467330e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:58:51.941835 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d15a3-7d43-4ee6-bbfe-b1c5467330e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:58:51.942121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d15a3-7d43-4ee6-bbfe-b1c5467330e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:58:51.942400 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d15a3-7d43-4ee6-bbfe-b1c5467330e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:58:51.944164 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9b7d15a3-7d43-4ee6-bbfe-b1c5467330e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:58:52.006152 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d15a3-7d43-4ee6-bbfe-b1c5467330e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:58:52.007595 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d15a3-7d43-4ee6-bbfe-b1c5467330e0 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:58:52.017707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1460/2887] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:58:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:59:02.013516 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=30 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:37.879134 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:59:37.880816 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:59:37.972283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18354ce8-58ec-4483-adfa-f1a9b619b56d service nova] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:59:37.977486 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:59:37.978133 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:37.978417 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:37.978691 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:37.980501 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:59:37.992099 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:59:37.993742 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:59:38.003841 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1428/2888] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 16:59:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:59:47.999366 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=41 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:51.051998 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91438191-0c73-4740-bc01-194ce7cf295a None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:59:51.052552 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91438191-0c73-4740-bc01-194ce7cf295a None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:59:51.052665 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91438191-0c73-4740-bc01-194ce7cf295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:59:51.069670 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-91438191-0c73-4740-bc01-194ce7cf295a None None] MFA Rules not processed for user `a2d904021dea4643b0f4420e33d4dbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:59:51.070884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-91438191-0c73-4740-bc01-194ce7cf295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:59:51.078544 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1461/2889] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 16:59:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:01.064989 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=3 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:35.740803 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:35.742227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:35.753723 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762580cb-7775-433f-96e0-38d483e313b6 service placement] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:35.757288 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f39c4-d398-4024-afd3-9ab345c4aaf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:35.757917 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f39c4-d398-4024-afd3-9ab345c4aaf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:35.758198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f39c4-d398-4024-afd3-9ab345c4aaf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:35.758470 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f39c4-d398-4024-afd3-9ab345c4aaf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:35.760158 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-1d1f39c4-d398-4024-afd3-9ab345c4aaf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:35.819063 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f39c4-d398-4024-afd3-9ab345c4aaf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:35.820457 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f39c4-d398-4024-afd3-9ab345c4aaf1 service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:35.830280 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1429/2890] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:00:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:45.825227 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=28 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:47.490653 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4fae2-89a8-43e8-8080-1bc936f0e2b5 None None] REQUEST_METHOD: `POST` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:47.491215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4fae2-89a8-43e8-8080-1bc936f0e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:47.491215 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4fae2-89a8-43e8-8080-1bc936f0e2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:47.509819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.auth.core [None req-20b4fae2-89a8-43e8-8080-1bc936f0e2b5 None None] MFA Rules not processed for user `2aa01ac54736475188dbc47f3cda4de1`. Rule list: `[]` (Enabled: `True`). {{(pid=80675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:00:47.511029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-20b4fae2-89a8-43e8-8080-1bc936f0e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:47.518311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1462/2891] 10.222.0.74 () {58 vars in 957 bytes} [Mon May 23 17:00:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:00:47.556708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f39c4-d398-4024-afd3-9ab345c4aaf1 service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:47.565745 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f39c4-d398-4024-afd3-9ab345c4aaf1 service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:47.569398 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac7f26-cd16-4af6-b786-6e42f84658ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d377792af1c4ad19519e2e98bac72e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:47.570035 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7f26-cd16-4af6-b786-6e42f84658ef service cinder] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:47.570320 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7f26-cd16-4af6-b786-6e42f84658ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:47.570598 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7f26-cd16-4af6-b786-6e42f84658ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:47.572394 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-e5ac7f26-cd16-4af6-b786-6e42f84658ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:47.606290 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac7f26-cd16-4af6-b786-6e42f84658ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:47.607762 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac7f26-cd16-4af6-b786-6e42f84658ef service cinder] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:47.628858 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1430/2892] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:00:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:48.648583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4fae2-89a8-43e8-8080-1bc936f0e2b5 None None] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:00:48.659082 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4fae2-89a8-43e8-8080-1bc936f0e2b5 None None] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:00:48.662867 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ff911-fc11-4190-b593-8218db1044a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:00:48.663517 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff911-fc11-4190-b593-8218db1044a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:00:48.663802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff911-fc11-4190-b593-8218db1044a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:00:48.664077 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff911-fc11-4190-b593-8218db1044a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:00:48.665906 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ee3ff911-fc11-4190-b593-8218db1044a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:00:48.681929 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff911-fc11-4190-b593-8218db1044a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:00:48.683453 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff911-fc11-4190-b593-8218db1044a0 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:00:48.695491 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1463/2893] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:00:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:00:57.625883 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=18 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:58.690130 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=9 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:05.963198 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac7f26-cd16-4af6-b786-6e42f84658ef service cinder] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:05.970794 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac7f26-cd16-4af6-b786-6e42f84658ef service cinder] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:05.975462 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:05.976350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:05.976639 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:05.976913 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] PATH_INFO: `/v3/users/a2d904021dea4643b0f4420e33d4dbf9` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:05.978116 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d904021dea4643b0f4420e33d4dbf9)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:05.980043 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:06.144097 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d904021dea4643b0f4420e33d4dbf9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.144800 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d904021dea4643b0f4420e33d4dbf9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.151983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d904021dea4643b0f4420e33d4dbf9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.163621 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d904021dea4643b0f4420e33d4dbf9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.262494 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d904021dea4643b0f4420e33d4dbf9'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.270587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1431/2894] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 17:01:05 2022] DELETE /identity/v3/users/a2d904021dea4643b0f4420e33d4dbf9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:01:06.504791 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ff911-fc11-4190-b593-8218db1044a0 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:06.515496 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ff911-fc11-4190-b593-8218db1044a0 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:06.577627 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:06.578487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:06.578767 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:06.579036 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] PATH_INFO: `/v3/projects/bc5eb587a333468a9ae2107de4e9831a` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:06.581020 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5eb587a333468a9ae2107de4e9831a)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:06.583008 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:06.707852 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5eb587a333468a9ae2107de4e9831a', 'request_id': 'req-f8667bc9-705f-447d-b610-8ff75bf7ab82'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.713301 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5eb587a333468a9ae2107de4e9831a', 'request_id': 'req-f8667bc9-705f-447d-b610-8ff75bf7ab82'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.746691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5eb587a333468a9ae2107de4e9831a', 'request_id': 'req-f8667bc9-705f-447d-b610-8ff75bf7ab82'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.758573 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] The token cache is being invalidate because project bc5eb587a333468a9ae2107de4e9831a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:01:06.758857 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.760175 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:01:06.761066 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1464/2895] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 17:01:06 2022] DELETE /identity/v3/projects/bc5eb587a333468a9ae2107de4e9831a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:01:10.827862 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:10.829521 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:10.885767 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a82d4e-f25a-4014-a180-1329c9495f21 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:10.932863 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:10.933517 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:10.933804 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:10.934086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:10.935889 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:10.977177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:10.997436 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:10.999107 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:11.009435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1432/2896] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:01:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:16.755525 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:21.038088 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=10 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:40.812011 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:40.813377 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:40.826246 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8667bc9-705f-447d-b610-8ff75bf7ab82 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:40.829814 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1820ef-13bf-4f77-aec9-dd96faf0ddb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:40.830487 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1820ef-13bf-4f77-aec9-dd96faf0ddb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:40.830772 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1820ef-13bf-4f77-aec9-dd96faf0ddb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:40.831048 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1820ef-13bf-4f77-aec9-dd96faf0ddb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:40.832807 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-aa1820ef-13bf-4f77-aec9-dd96faf0ddb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:40.842067 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1820ef-13bf-4f77-aec9-dd96faf0ddb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:40.843479 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1820ef-13bf-4f77-aec9-dd96faf0ddb2 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:40.852043 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1465/2897] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:01:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:50.848603 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=6 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:56.208400 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:56.209854 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:56.220831 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0ba2e-ca90-4af6-be0f-f10f12d6c426 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:56.225488 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:56.226132 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:56.226410 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:56.226683 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:56.228471 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:56.238144 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:56.239612 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:56.247979 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1433/2898] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:01:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:01:56.338464 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1820ef-13bf-4f77-aec9-dd96faf0ddb2 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:01:56.347321 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1820ef-13bf-4f77-aec9-dd96faf0ddb2 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:01:56.352392 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f52ae5-c8eb-4850-a6c8-2465bf8c7ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:01:56.353038 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f52ae5-c8eb-4850-a6c8-2465bf8c7ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:01:56.353319 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f52ae5-c8eb-4850-a6c8-2465bf8c7ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:01:56.353590 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f52ae5-c8eb-4850-a6c8-2465bf8c7ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:01:56.355353 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-21f52ae5-c8eb-4850-a6c8-2465bf8c7ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:01:56.427917 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f52ae5-c8eb-4850-a6c8-2465bf8c7ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:01:56.429306 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f52ae5-c8eb-4850-a6c8-2465bf8c7ce8 service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:01:56.439856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1466/2899] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:01:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:02:06.244013 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=6 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:02:06.435217 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=34 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:03.296872 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:03.298983 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:03.321283 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce53f-8abc-48ad-acfa-48d6c2948875 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:03.329117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:03.329117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:03.329117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:03.329117 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:03.331241 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:03.345390 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:03.347605 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:03.360094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1434/2900] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:03:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:13.355152 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=6 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:17.792742 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f52ae5-c8eb-4850-a6c8-2465bf8c7ce8 service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:17.801513 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f52ae5-c8eb-4850-a6c8-2465bf8c7ce8 service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:17.805398 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be462b08-1687-4385-bc43-7c9c241c190d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:17.806030 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be462b08-1687-4385-bc43-7c9c241c190d service neutron] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:17.806311 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be462b08-1687-4385-bc43-7c9c241c190d service neutron] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:17.806584 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be462b08-1687-4385-bc43-7c9c241c190d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:17.808359 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-be462b08-1687-4385-bc43-7c9c241c190d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:17.871343 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be462b08-1687-4385-bc43-7c9c241c190d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:17.872819 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be462b08-1687-4385-bc43-7c9c241c190d service neutron] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:17.882340 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1467/2901] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:21.452786 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:21.454261 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:21.534708 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3208-3b1d-44ba-bd42-ca5325087791 service nova] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:21.540375 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:21.541029 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:21.541312 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:21.541587 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:21.543350 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:21.554859 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:21.557459 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:21.566558 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1435/2902] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:03:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:25.112266 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be462b08-1687-4385-bc43-7c9c241c190d service neutron] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:25.124777 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be462b08-1687-4385-bc43-7c9c241c190d service neutron] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:25.129813 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a25c-47e9-4825-8190-14dad1274402 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:25.130493 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a25c-47e9-4825-8190-14dad1274402 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:25.130779 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a25c-47e9-4825-8190-14dad1274402 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:25.131060 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a25c-47e9-4825-8190-14dad1274402 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:25.139672 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-c8e8a25c-47e9-4825-8190-14dad1274402 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:25.151909 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8a25c-47e9-4825-8190-14dad1274402 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:25.153553 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8a25c-47e9-4825-8190-14dad1274402 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:25.164935 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1468/2903] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:03:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:25.242418 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:25.243441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:25.258246 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a49a6-4c0c-4e16-a2f3-9aad582c69bd service placement] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:25.262909 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:25.263766 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:25.264072 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:25.264376 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] PATH_INFO: `/v3/users/2aa01ac54736475188dbc47f3cda4de1` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:25.265551 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa01ac54736475188dbc47f3cda4de1)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:25.267452 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:25.454345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa01ac54736475188dbc47f3cda4de1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:25.455002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa01ac54736475188dbc47f3cda4de1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:25.462565 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa01ac54736475188dbc47f3cda4de1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:25.474300 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa01ac54736475188dbc47f3cda4de1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:25.548894 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa01ac54736475188dbc47f3cda4de1'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:25.555238 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1436/2904] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 17:03:25 2022] DELETE /identity/v3/users/2aa01ac54736475188dbc47f3cda4de1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:25.831934 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a25c-47e9-4825-8190-14dad1274402 service placement] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:25.843856 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a25c-47e9-4825-8190-14dad1274402 service placement] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:25.907501 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:25.908318 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:25.908604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:25.908884 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] PATH_INFO: `/v3/projects/8d09d9819e564152aacc661d1da68fcd` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:25.910085 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d09d9819e564152aacc661d1da68fcd)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:25.912084 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:26.000489 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d09d9819e564152aacc661d1da68fcd', 'request_id': 'req-b9130a94-2632-4054-9ae5-5c12971288fd'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.005938 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d09d9819e564152aacc661d1da68fcd', 'request_id': 'req-b9130a94-2632-4054-9ae5-5c12971288fd'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.051691 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d09d9819e564152aacc661d1da68fcd', 'request_id': 'req-b9130a94-2632-4054-9ae5-5c12971288fd'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.063360 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] The token cache is being invalidate because project 8d09d9819e564152aacc661d1da68fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:03:26.064121 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.064394 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.065948 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1469/2905] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 17:03:25 2022] DELETE /identity/v3/projects/8d09d9819e564152aacc661d1da68fcd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:26.070715 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:26.072441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:26.085751 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef3bac-c442-496e-918f-3f57131342a8 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:26.142046 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:26.142912 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:26.143192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:26.143467 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] PATH_INFO: `/v3/users/c7a20d27749940319d31c144a5c12787` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:26.144685 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a20d27749940319d31c144a5c12787)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:26.146615 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:26.151094 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:26.318177 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a20d27749940319d31c144a5c12787'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.318950 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a20d27749940319d31c144a5c12787'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.326173 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a20d27749940319d31c144a5c12787'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.338677 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a20d27749940319d31c144a5c12787'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.394820 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a20d27749940319d31c144a5c12787'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.401156 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1437/2906] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 17:03:26 2022] DELETE /identity/v3/users/c7a20d27749940319d31c144a5c12787 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:03:26.654361 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:26.655851 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:26.672074 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9130a94-2632-4054-9ae5-5c12971288fd admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:26.680677 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:26.734802 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:26.735669 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:26.735959 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:26.736320 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] PATH_INFO: `/v3/projects/329486f3fa4d426b982fa352f8a57f1a` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:26.737532 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=329486f3fa4d426b982fa352f8a57f1a)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:26.739507 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:26.857671 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329486f3fa4d426b982fa352f8a57f1a', 'request_id': 'req-ab64b535-2e04-46ba-852f-ddfee975a3e5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.863065 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329486f3fa4d426b982fa352f8a57f1a', 'request_id': 'req-ab64b535-2e04-46ba-852f-ddfee975a3e5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.920498 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329486f3fa4d426b982fa352f8a57f1a', 'request_id': 'req-ab64b535-2e04-46ba-852f-ddfee975a3e5'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.931820 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] The token cache is being invalidate because project 329486f3fa4d426b982fa352f8a57f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:03:26.932108 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.932760 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:03:26.934329 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1470/2907] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 17:03:26 2022] DELETE /identity/v3/projects/329486f3fa4d426b982fa352f8a57f1a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:03:36.397341 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:36.928735 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:56.178969 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:56.181249 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:56.238867 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433d7d1-c657-4d7f-a654-91de482d26d6 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:56.285653 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:56.286301 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:56.286585 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:56.286863 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:56.288646 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:56.346320 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:56.347753 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:56.357192 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1438/2908] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:03:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:03:59.665784 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:03:59.667296 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:59.740331 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64b535-2e04-46ba-852f-ddfee975a3e5 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:03:59.746583 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '951eca3289634609bcb684181e147ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:03:59.748548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:03:59.748548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:03:59.748548 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:03:59.749645 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:03:59.762623 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:03:59.764202 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:03:59.774743 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1471/2909] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:03:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:04:01.431885 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:01.436485 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:01.444146 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a1d81-dcd2-4db3-908d-07d5113521fb service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:01.448234 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604145-4953-43d0-960d-4b0de7b68da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a833149a66af4452aeedd5d43f2fb2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:01.448939 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604145-4953-43d0-960d-4b0de7b68da5 service neutron] REQUEST_METHOD: `GET` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:01.449226 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604145-4953-43d0-960d-4b0de7b68da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:01.449506 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604145-4953-43d0-960d-4b0de7b68da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:01.451263 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-99604145-4953-43d0-960d-4b0de7b68da5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:01.513996 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99604145-4953-43d0-960d-4b0de7b68da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:01.515441 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99604145-4953-43d0-960d-4b0de7b68da5 service neutron] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:01.525212 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1439/2910] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:04:08.875283 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:08.876900 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:08.892029 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c7e1-bd62-462f-99a9-91ef904a9e4d service nova] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:08.896528 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:08.897420 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:08.897703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:08.897977 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] PATH_INFO: `/v3/users/43e80a38a048456ba61ce41648475374` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:08.899142 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e80a38a048456ba61ce41648475374)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:08.901210 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.054000 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e80a38a048456ba61ce41648475374'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.131335 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e80a38a048456ba61ce41648475374'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.132007 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e80a38a048456ba61ce41648475374'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.132604 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e80a38a048456ba61ce41648475374'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.140271 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e80a38a048456ba61ce41648475374'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.157696 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1472/2911] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 17:04:08 2022] DELETE /identity/v3/users/43e80a38a048456ba61ce41648475374 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:09.378575 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604145-4953-43d0-960d-4b0de7b68da5 service neutron] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:09.386863 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=100 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:09.391967 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604145-4953-43d0-960d-4b0de7b68da5 service neutron] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:09.454682 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:09.455461 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:09.455747 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:09.456028 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] PATH_INFO: `/v3/projects/6ae6212e50a1473a91e3abcff84f6f9b` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:09.457243 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae6212e50a1473a91e3abcff84f6f9b)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:09.459160 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.568907 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae6212e50a1473a91e3abcff84f6f9b', 'request_id': 'req-ce137ee0-6839-4dcc-bc59-5d7af8077458'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.642874 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae6212e50a1473a91e3abcff84f6f9b', 'request_id': 'req-ce137ee0-6839-4dcc-bc59-5d7af8077458'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.649483 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae6212e50a1473a91e3abcff84f6f9b', 'request_id': 'req-ce137ee0-6839-4dcc-bc59-5d7af8077458'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.659784 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] The token cache is being invalidate because project 6ae6212e50a1473a91e3abcff84f6f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:04:09.660086 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.660733 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:09.662278 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1440/2912] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 17:04:09 2022] DELETE /identity/v3/projects/6ae6212e50a1473a91e3abcff84f6f9b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:09.666973 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:09.668428 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:09.682490 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55886f43-067b-49b2-9a25-8855188a0ebc admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:09.731828 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:09.737492 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:09.738358 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:09.738644 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:09.738921 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] PATH_INFO: `/v3/users/0399bcccea2541cd8bd13584b371e7c1` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:09.740099 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0399bcccea2541cd8bd13584b371e7c1)` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:09.742078 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:09.964876 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0399bcccea2541cd8bd13584b371e7c1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.054061 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0399bcccea2541cd8bd13584b371e7c1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.054703 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0399bcccea2541cd8bd13584b371e7c1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.055307 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0399bcccea2541cd8bd13584b371e7c1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.062781 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.notifications [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0399bcccea2541cd8bd13584b371e7c1'} {{(pid=80675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.080312 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1473/2913] 10.222.0.74 () {58 vars in 1223 bytes} [Mon May 23 17:04:09 2022] DELETE /identity/v3/users/0399bcccea2541cd8bd13584b371e7c1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:10.332810 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] Authenticating user token {{(pid=80676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:10.334251 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.fernet_utils [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:10.348399 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce137ee0-6839-4dcc-bc59-5d7af8077458 admin admin] Validating token access rules against request {{(pid=80676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:10.407809 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f0fe22fa44447e8acda5720d7e2ffa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a06edcae6b7a4521b29d4cfac1cfa2c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:10.408707 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:10.408992 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:10.409271 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] PATH_INFO: `/v3/projects/8147630404c14b24a620ff1ec387ba52` {{(pid=80676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:10.410463 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8147630404c14b24a620ff1ec387ba52)` {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:10.412435 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] RBAC: Authorization granted {{(pid=80676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:10.546002 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:10.554281 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8147630404c14b24a620ff1ec387ba52', 'request_id': 'req-6636f594-132e-4ec9-b94b-b28b3f422aef'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.639643 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8147630404c14b24a620ff1ec387ba52', 'request_id': 'req-6636f594-132e-4ec9-b94b-b28b3f422aef'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.646345 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8147630404c14b24a620ff1ec387ba52', 'request_id': 'req-6636f594-132e-4ec9-b94b-b28b3f422aef'} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.658359 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] The token cache is being invalidate because project 8147630404c14b24a620ff1ec387ba52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 17:04:10.661926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.661926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG keystone.notifications [None req-6636f594-132e-4ec9-b94b-b28b3f422aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 17:04:10.661926 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: [pid: 80676|app: 0|req: 1441/2914] 10.222.0.74 () {58 vars in 1232 bytes} [Mon May 23 17:04:10 2022] DELETE /identity/v3/projects/8147630404c14b24a620ff1ec387ba52 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:04:20.076707 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:20.717701 dv-cinder-839257-3-iscsi devstack@keystone.service[80676]: DEBUG dbcounter [-] [80676] Writing DB stats keystone:SELECT=11,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:04:42.501019 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] Authenticating user token {{(pid=80675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:04:42.502499 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:42.571826 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011fb9e-0589-4147-a8a4-204a91217b31 admin admin] Validating token access rules against request {{(pid=80675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:04:42.630423 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e179aeb-5efc-4918-ab00-b04bdcac8c29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5997b3965f44d6fbdf55cccdfc52ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fcd51ba67a49918509c136e8f7d21a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:04:42.631072 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e179aeb-5efc-4918-ab00-b04bdcac8c29 service placement] REQUEST_METHOD: `GET` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:04:42.631357 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e179aeb-5efc-4918-ab00-b04bdcac8c29 service placement] SCRIPT_NAME: `/identity` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:04:42.631634 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e179aeb-5efc-4918-ab00-b04bdcac8c29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:04:42.633466 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.fernet_utils [None req-9e179aeb-5efc-4918-ab00-b04bdcac8c29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:04:42.645148 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e179aeb-5efc-4918-ab00-b04bdcac8c29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:04:42.646778 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e179aeb-5efc-4918-ab00-b04bdcac8c29 service placement] RBAC: Authorization granted {{(pid=80675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:04:42.656976 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: [pid: 80675|app: 0|req: 1474/2915] 10.222.0.74 () {60 vars in 1365 bytes} [Mon May 23 17:04:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:04:52.652485 dv-cinder-839257-3-iscsi devstack@keystone.service[80675]: DEBUG dbcounter [-] [80675] Writing DB stats keystone:SELECT=58 {{(pid=80675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}